vllm/entrypoints/openai/api_server.py · 7c7714d856eee6fa94aade729b67f00584f72a4c · OpenDAS / vllm_cscc

"tests/kernels/test_blocksparse_attention.py" did not exist on "6e01e8c1c8ea323d30e3f57050469b2df66b56c6"

[Core][Bugfix][Perf] Introduce `MQLLMEngine` to avoid `asyncio` OH (#8157) · 7c7714d8

Alexander Matveev authored Sep 18, 2024


Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

7c7714d8

api_server.py 20.9 KB

Replace api_server.py