Commits · f4b42df04847dcbd3247f7f4c56dff45e40bdf0d · OpenDAS / vllm_cscc

"tests/entrypoints/instrumentator/__init__.py" did not exist on "0b98ba15c744f1dfb0ea4f2135e85ca23d572ae1"

15 Apr, 2026 1 commit

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479) · f4b42df0

Vibhav Agarwal authored Apr 15, 2026


Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f4b42df0

14 Apr, 2026 1 commit

add warning when FP8 KV cache misses prefill query quantization (#39752) · dc8df110

Albert Cheng authored Apr 14, 2026

Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-lyris02.lyris.clusters.nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

dc8df110

10 Apr, 2026 1 commit
- [compile] Allow strings in custom ops without regressing compilation times (#38123) · f44afef6
  Richard Zou authored Apr 10, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  f44afef6
07 Apr, 2026 1 commit
- [Attention][V0 Deprecation] Deprecate accept output buffer (#39125) · 70406eb1
  Lucas Wilkinson authored Apr 07, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  70406eb1
06 Apr, 2026 1 commit
- [EASY] Drop duplicate KV-cache initialization (#38799) · 94fbb098
  namgyu-youn authored Apr 07, 2026
```
Signed-off-by: namgyu-youn <namgyu.dev@gmail.com>
```
  94fbb098
03 Apr, 2026 1 commit

[mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) · 1f5ec288

Carl Y authored Apr 02, 2026

Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

1f5ec288

02 Apr, 2026 1 commit

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378) · 2ce3d0ce

JartX authored Apr 02, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yangyang4991 <yangyang4991@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2ce3d0ce

01 Apr, 2026 1 commit
- [1/N][Cleanup] Standardize on use of `is_quantized_kv_cache` (#38659) · 116f4be4
  Matthew Bonanni authored Apr 01, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  116f4be4
31 Mar, 2026 2 commits
- [fix] Remove trtllm ragged mla prefills (#36540) · 598190aa
  Olya Kozlova authored Mar 31, 2026
```
Signed-off-by: Olya Kozlova <okozlova@nvidia.com>
```
  598190aa
- Fix MLA runs when use_inductor_graph_partition=True (#38631) · 202f147c
  ElizaWszola authored Mar 31, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  202f147c
27 Mar, 2026 1 commit
- enable skipping of SW attention layers when using FP8 KV cache (#33695) · 98e7f223
  Jonas M. Kübler authored Mar 27, 2026
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  98e7f223
25 Mar, 2026 1 commit
- [XPU] support MLA model on Intel GPU (#37143) · 14771f71
  Kunshang Ji authored Mar 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  14771f71
24 Mar, 2026 1 commit
- [V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c59a132f
23 Mar, 2026 1 commit

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac

Ranran authored Mar 23, 2026


Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc6908ac

18 Mar, 2026 2 commits
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [Log] Reduce duplicate log (#37313) · c373b5c0
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c373b5c0
17 Mar, 2026 1 commit
- Add ability to replace oot ops when using lora (#37181) · 0a0a1a19
  Kyuyeun Kim authored Mar 16, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  0a0a1a19
16 Mar, 2026 1 commit
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
13 Mar, 2026 1 commit
- [Bugfix] Fix MLA attention crash with AWQ/GPTQ quantized models (#34695) · 6d53efd2
  haosdent authored Mar 14, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  6d53efd2
12 Mar, 2026 3 commits
- [Attention] Use FA4 for MLA prefill (#34732) · f444c05c
  Matthew Bonanni authored Mar 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f444c05c
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [MM][OOT] Support CPU `seq_lens` for OOT MMEncoderAttention kernels (#36605) · f0d3658c
  Shanshan Shen authored Mar 12, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f0d3658c
11 Mar, 2026 1 commit
- Add 320 dimension size support to MLA (#36161) · a5d06dc5
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a5d06dc5
09 Mar, 2026 1 commit
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
07 Mar, 2026 2 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- mla: don't update kv cache on dummy forwards (#36282) · 24a03915
  Itay Alroy authored Mar 07, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  24a03915
05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

04 Mar, 2026 1 commit

[Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109

sungsoo ha authored Mar 04, 2026


Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6cb90109

02 Mar, 2026 1 commit

[Performance] Extract kv update ops from MLA attention backends (#34627) · d9c77308

ElizaWszola authored Mar 02, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Di Wu <dw2761@nyu.edu>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d9c77308

01 Mar, 2026 1 commit

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

27 Feb, 2026 1 commit

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993

24 Feb, 2026 2 commits

[Attn,KV-cache] Use per-head scales in the attention selector (#34281) · a87cc508

Eldar Kurtić authored Feb 24, 2026


Signed-off-by: Your Name <you@example.com>
Signed-off-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Your Name <you@example.com>

a87cc508

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

23 Feb, 2026 1 commit
- [XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010) · b1b5e045
  Yan Ma authored Feb 23, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  b1b5e045
22 Feb, 2026 1 commit
- [Model Bash][DSR1] Add selective dynamic shape marking for CustomOp (#34900) · 74d90b1c
  Vadim Gimpelson authored Feb 22, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  74d90b1c
20 Feb, 2026 1 commit
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
19 Feb, 2026 1 commit

[Bugfix] Fix Basic Models Test (#34818) · 662205d3

Matthew Bonanni authored Feb 19, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

662205d3

15 Feb, 2026 1 commit
- [MM Encoder] Add Triton ViT attention backend (#32183) · 71cd8926
  Isotr0py authored Feb 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  71cd8926
12 Feb, 2026 1 commit

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

10 Feb, 2026 1 commit
- [SM100] Resubmit FMHA FP8 prefill for MLA (#31195) · 578977bb
  Pavani Majety authored Feb 10, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  578977bb