vllm/utils.py · 8958217ad5a6830c4d911e5f15e6eb791df337b6 · OpenDAS / vllm_cscc · GitLab

"docs/vscode:/vscode.git/clone" did not exist on "8fb7b2fab9cec7866c0685513df29048ef60d41c"

Find file Blame History Permalink

[Bugfix] Fix use_cascade_attention handling for Alibi-based models on vllm/v1 (#15211) · 8958217a
Hiroaki Sugiyama authored Mar 27, 2025
```
Signed-off-by: h-sugi <h.sugi@ieee.org>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
8958217a

utils.py 82.3 KB