vllm/worker/model_runner_base.py · 59a0192fb9bef026086d0a2ed32705d870a9466a · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core] Interface for accessing model from `VllmRunner` (#10353) · 59a0192f
Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
59a0192f

model_runner_base.py 10.5 KB