Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
0d63541816fa9358e1d896cdffd503aa8b9c623c
Switch branch/tag
dynamo
lib
tokenizers
src
fastokens.rs
23 Apr, 2026
1 commit
feat: split tokenizer code into dynamo-tokenizers crate (#8185)
· 0d635418
ishandhanani
authored
Apr 23, 2026
0d635418
14 Apr, 2026
1 commit
feat: Decoder clean-up for handling incomplete multi-byte sequence (#8022)
· 2cabf441
Biswa Panda
authored
Apr 13, 2026
2cabf441
15 Mar, 2026
1 commit
feat: integrate fastokens BPE tokenizer backend (#7387)
· da810a26
Biswa Panda
authored
Mar 15, 2026
da810a26
