vllm/engine/llm_engine.py · 96b6f475dda40a0c7d557f73c36fe09c07be2e9c · xdb4_94051 / vllm · GitLab

"docs/backend/send_request.ipynb" did not exist on "be7986e00544a28832841c916c07793173fd512c"

Find file Blame History Permalink

Remove hardcoded `device="cuda" ` to support more devices (#2503) · 96b6f475
Kunshang Ji authored Feb 02, 2024
```
Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
96b6f475

llm_engine.py 42.1 KB