vllm/entrypoints/openai/run_batch.py · 4d3a2c284ecc47748273664c9a6ef302ff3adcbe · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Misc] Split up pooling tasks (#10820) · 8f10d5e3
Cyrus Leung authored Dec 11, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
8f10d5e3

run_batch.py 11.1 KB