vllm/worker/multi_step_model_runner.py · 39d3f8d94fd2691b70ee809e7565402f8a061c6b · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) · c2ec430a
Varun Sundar Rabindranath authored Sep 27, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
c2ec430a

multi_step_model_runner.py 37.4 KB