vllm/transformers_utils/tokenizer.py · 58eee5f2e05b74eb2cb1a3bbda9c04df4805e4cc · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[PERF] Use faster way of decode in tokenizer: avoid useless list-to-list conversion (#20000) · 58eee5f2
Vadim Gimpelson authored Aug 02, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
58eee5f2

tokenizer.py 11.2 KB