vllm/transformers_utils/detokenizer_utils.py · d2b52805f24ba63e3bc7d873f74caa17ac9ff36f · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Perf] Speed up function `_convert_tokens_to_string_with_added_encoders` by 13.7x (#20413) · bf7c99df

Saurabh Misra authored Aug 20, 2025

Signed-off-by: Saurabh Misra <misra.saurabh1@gmail.com>
Signed-off-by: Aseem Saxena <aseem.bits@gmail.com>
Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
Co-authored-by: Aseem Saxena <aseem.bits@gmail.com>

bf7c99df

detokenizer_utils.py 7.47 KB