vllm/utils/async_utils.py · 999dfc1622d042dffbe4e273056fa4554453c8e7 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) · 999dfc16
Bvicii authored Mar 26, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
999dfc16

async_utils.py 11.2 KB