tests/entrypoints/openai/test_async_tokenization.py · f256ebe4df6757d76f1f1642d7e110268a2f8190 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server (#10635) · 395b1c74
tomeras91 authored Nov 27, 2024
```
Signed-off-by: Tomer Asida <tomera@ai21.com>
```
395b1c74

test_async_tokenization.py 3.69 KB