vllm/worker/model_runner.py · ea356004d4749627bd1c65b7f71c76f51b5c45be · kecinstone / 2024pra-vllm · GitLab

Find file Blame History Permalink

Remove hardcoded `device="cuda" ` to support more devices (#2503) · 96b6f475
Kunshang Ji authored Feb 02, 2024
```
Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
96b6f475

model_runner.py 35 KB