Microsoft.ML.Tokenizers 0.21.1

Microsoft.ML.Tokenizers contains the implmentation of the tokenization used in the NLP transforms.

Showing the top 20 packages that depend on Microsoft.ML.Tokenizers.

Packages Downloads
Microsoft.Agents.AI
Provides Microsoft Agent Framework core functionality.
2
Microsoft.Agents.AI
Provides Microsoft Agent Framework core functionality.
3
Microsoft.Agents.AI.Workflows
Provides Microsoft Agent Framework support for workflows.
2
Microsoft.Agents.AI.Workflows
Provides Microsoft Agent Framework support for workflows.
3
Microsoft.Extensions.AI.Evaluation
A library containing core abstractions for evaluating responses received from an LLM.
2

.NET Standard 2.0

Version Downloads Last updated
3.0.0 2 11/15/2026
3.0.0-preview.26513.4 2 11/16/2026
3.0.0-preview.26457.2 2 11/16/2026
3.0.0-preview.26160.2 2 11/15/2026
2.0.1 2 11/15/2026
2.0.0 2 11/15/2026
2.0.0-preview.25527.5 2 11/15/2026
2.0.0-preview.25503.2 2 11/15/2026
2.0.0-preview.25373.1 2 11/15/2026
2.0.0-preview.1.25127.4 2 11/15/2026
2.0.0-preview.1.25125.4 2 11/15/2026
1.0.3 2 11/15/2026
1.0.2 2 11/15/2026
1.0.1 2 11/15/2026
1.0.0 2 11/15/2026
0.22.0 2 11/15/2026
0.22.0-preview.24526.1 2 11/15/2026
0.22.0-preview.24522.7 2 11/15/2026
0.22.0-preview.24378.1 2 11/15/2026
0.22.0-preview.24271.1 2 11/15/2026
0.22.0-preview.24179.1 2 11/15/2026
0.22.0-preview.24162.2 2 11/15/2026
0.21.1 2 11/15/2026
0.21.0 2 11/15/2026
0.21.0-preview.23511.1 2 11/15/2026
0.21.0-preview.23266.6 2 11/15/2026
0.21.0-preview.22621.2 2 11/15/2026
0.20.1 2 11/15/2026
0.20.1-preview.22573.9 2 11/15/2026
0.20.0 2 11/15/2026
0.20.0-preview.22551.1 2 11/15/2026