vllm/transformers_utils/detokenizer_utils.py · 17edd8a807019c8d1e58634aecb1de7984e8d467 · OpenDAS / vllm_cscc · GitLab

"lib/llm/vscode:/vscode.git/clone" did not exist on "9b1e461e2f051242cfe227ed561a34e89668220b"

Find file Blame History Permalink

[Perf] Speed up function `_convert_tokens_to_string_with_added_encoders` by 13.7x (#20413) · bf7c99df

Saurabh Misra authored Aug 20, 2025

Signed-off-by: Saurabh Misra <misra.saurabh1@gmail.com>
Signed-off-by: Aseem Saxena <aseem.bits@gmail.com>
Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
Co-authored-by: Aseem Saxena <aseem.bits@gmail.com>

bf7c99df

detokenizer_utils.py 7.47 KB