vllm/worker/cache_engine.py · 7e1d5e5308fa3549dfed1821188d588260a03c8a · kecinstone / 2024pra-vllm · GitLab

"vllm/model_executor/models/internlm.py" did not exist on "c9d5b6d4a8b3f51ff6c9eee7eb52bb5149d89b6a"

Find file Blame History Permalink

Remove hardcoded `device="cuda" ` to support more devices (#2503) · 96b6f475
Kunshang Ji authored Feb 02, 2024
```
Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
96b6f475

cache_engine.py 6.23 KB