vllm/model_executor/layers/batch_invariant.py · b7a26050200e20917871a4a6b09df0bc9ea3fdc7 · OpenDAS / vllm_cscc

[Bugfix] Make Attention Backend Auto-Selection Batch-Invariance-Aware (#40193) · b7a26050

Srreyansh Sethi authored Apr 23, 2026


Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

b7a26050

batch_invariant.py 31.5 KB

Replace batch_invariant.py