vllm/v1/sample/sampler.py · f256ebe4df6757d76f1f1642d7e110268a2f8190 · OpenDAS / vllm_cscc · GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "5b2dcbf0b8dd9ee9199d7496c84e84c010122a00"

Find file Blame History Permalink

[V1][Perf] Reduce scheduling overhead in model runner after cuda sync (#12094) · fa63e710
Keyun Tong authored Jan 26, 2025
```
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
```
fa63e710

sampler.py 4.91 KB