vllm/transformers_utils/tokenizer_base.py · 1c2bc7ead019cdf5b04b2f1d07b00982352f85ef · OpenDAS / vllm_cscc

Truncation control for embedding models (#14776) · 1c2bc7ea

Gabriel Marinho authored Apr 29, 2025


Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1c2bc7ea

tokenizer_base.py 3.87 KB

Replace tokenizer_base.py