vllm/transformers_utils/detokenizer_utils.py · bf7c99dfc40bff6844b2ae57554516922eb93b71 · OpenDAS / vllm_cscc · GitLab

"vscode:/vscode.git/clone" did not exist on "8cb24d3aedb9f431fb15a636a3e11a00262f5991"

Find file Blame History Permalink

[Perf] Speed up function `_convert_tokens_to_string_with_added_encoders` by 13.7x (#20413) · bf7c99df

Saurabh Misra authored Aug 20, 2025

Signed-off-by: Saurabh Misra <misra.saurabh1@gmail.com>
Signed-off-by: Aseem Saxena <aseem.bits@gmail.com>
Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
Co-authored-by: Aseem Saxena <aseem.bits@gmail.com>

bf7c99df

detokenizer_utils.py 7.47 KB