vllm/worker/hpu_model_runner.py · 6e650f56a16618db87147d97f699fa407ed1205d · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core] Interface for accessing model from `VllmRunner` (#10353) · 59a0192f
Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
59a0192f

hpu_model_runner.py 87 KB