vllm/v1/engine/async_llm.py · 1c2bc7ead019cdf5b04b2f1d07b00982352f85ef · OpenDAS / vllm_cscc

Truncation control for embedding models (#14776) · 1c2bc7ea

Gabriel Marinho authored Apr 29, 2025


Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1c2bc7ea

async_llm.py 20.6 KB

Replace async_llm.py