examples/offline_inference/load_sharded_state.py · 463bbb1835b8bbb1a80e6286c6396f6f3182c4f7 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix][V1] Fix bug from putting llm_engine.model_executor in a background process (#15367) · 463bbb18
wwl2755 authored Apr 03, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
463bbb18

load_sharded_state.py 2.7 KB