Commits · 0b2c14e39c4eb7fe1540097c56312a702f7b0797 · OpenDAS / vllm_cscc

24 Feb, 2026 1 commit
- fix glm fp8-e4m3 acc error · 0b2c14e3
  zhuwenwen authored Feb 24, 2026
  
  0b2c14e3
12 Feb, 2026 1 commit
- update fa_version · b52c0d8c
  zhuwenwen authored Feb 12, 2026
  
  b52c0d8c
27 Jan, 2026 1 commit
- Q支持fp8 · 1a3ed91b
  xiabo authored Jan 27, 2026
  
  1a3ed91b
23 Jan, 2026 1 commit
- add fp8 support on bw · 88411543
  zhuwenwen authored Jan 23, 2026
  
  88411543
21 Jan, 2026 1 commit
- 1、kvcache支持fp8的scale · 3d01cce7
  xiabo authored Jan 21, 2026
  
  3d01cce7
15 Jan, 2026 2 commits
- remove unused · f4cef40c
  zhuwenwen authored Jan 15, 2026
  
  f4cef40c
- support fa kvcache fp8 · c8bd8db7
  zhuwenwen authored Jan 15, 2026
```
todo: add VLLM_USE_QUERY_QUANT to not use q quant
```
  c8bd8db7
10 Jan, 2026 2 commits
- remove attn_masks · 58de8cd6
  zhuwenwen authored Jan 10, 2026
  
  58de8cd6
- remove pa · 29a9e952
  zhuwenwen authored Jan 10, 2026
  
  29a9e952
24 Dec, 2025 1 commit
- update flash_mla_with_kvcache · fd8e4a76
  zhuwenwen authored Dec 24, 2025
```
set VLLM_USE_PIECEWISE=0
```
  fd8e4a76
05 Dec, 2025 1 commit
- update mla interface · 31021d81
  zhuwenwen authored Dec 05, 2025
  
  31021d81
13 Nov, 2025 1 commit
- add VLLM_USE_OPT_ZEROS to replace triton_ (torch.zeros) · e7f2785f
  zhuwenwen authored Nov 13, 2025
```
set default_max_num_batched_tokens = 10240
update qwen3_moe of layernorm
off lightop of moe_fused_gate
```
  e7f2785f
31 Oct, 2025 1 commit
- remove fp8_e5m2 error · 653b799b
  zhuwenwen authored Oct 31, 2025
  
  653b799b
20 Oct, 2025 1 commit
- switching to the implementation of MHA in FA · 7f417161
  zhuwenwen authored Oct 20, 2025
  
  7f417161
11 Oct, 2025 1 commit
- remove two_batch_overlap · 88443051
  zhuwenwen authored Oct 11, 2025
  
  88443051
02 Oct, 2025 1 commit
- [BugFix] ChunkedLocalAttention is currently not CG compatible (#26034) · c536881a
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  c536881a
01 Oct, 2025 2 commits

[bugfix][deepseek] fix flashmla kernel selection (#25956) · 83f3c9be
youkaichao authored Oct 01, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
83f3c9be

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-...

b3230e1a

25 Sep, 2025 4 commits
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
- [torch.compile] Make Query Quantization Fusable (#24914) · 69a8c8e9
  Jonas M. Kübler authored Sep 25, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  69a8c8e9
- [XPU][Triton]add xpu config in triton_reshape_and_cache_flash (#25643) · d2af6744
  Kunshang Ji authored Sep 25, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  d2af6744
- [Kernel] Support DCP for Triton backend (#25132) · 05c19485
  Wei Wei authored Sep 24, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  05c19485
24 Sep, 2025 3 commits
- [V0 Deprecation] Remove unused classes in attention (#25541) · e6750d0b
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  e6750d0b
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050
- [V0 Deprecation] Remove max_seq_len_to_capture (#25543) · 2e19a848
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e19a848
23 Sep, 2025 5 commits
- Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7361ab37
- Fix triton_reshape_and_cache_flash.py triton import (#25522) · 4f2954f7
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4f2954f7
- [V0 Deprecation] Remove placeholder attn (#25510) · 969b4da3
  Thomas Parnell authored Sep 24, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  969b4da3
- [V1][Kernel] Add triton implementation for `reshape_and_cache_flash` (#24503) · 100b630a
  Burkhard Ringlein authored Sep 23, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chih-Chieh Yang <chih.chieh.yang@ibm.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  100b630a
- [Bugfix] Remove contiguous output req for context parallel MLA (#25414) · 78237e43
  Michael Goin authored Sep 22, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  78237e43
22 Sep, 2025 2 commits
- [Misc] Remove unused encoder-decoder error strings (#25374) · 417a164a
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  417a164a
- [V0 Deprecation] Remove `MultiModalPlaceholderMap` (#25366) · f92d9526
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f92d9526
21 Sep, 2025 3 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328) · 1cd885bd
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1cd885bd
- [V0 Deprecation] Remove V0 core (#25321) · c99db8c8
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c99db8c8
20 Sep, 2025 2 commits

[BUG FIX][NON-CUDA]quick fix to avoid call cudagraph_unsafe in attention (#25298) · 6c5f82e5
Chendi.Xue authored Sep 19, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
6c5f82e5

[torch.compile] CUDAGraph Inductor partition integration (#24281) · 8945b001

Boyuan Feng authored Sep 19, 2025


Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Signed-off-by: boyuanfeng <boyuan@meta.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8945b001

19 Sep, 2025 3 commits
- Optimize triton unified attention performance for sliding window attention (#24390) · a2a5f79e
  qizixi authored Sep 19, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  a2a5f79e
- Encoder model support for the Transformers backend (#25174) · 12aed7e4
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  12aed7e4
- [bugfix] fix MHA for models like OpenGVLab/InternVL3_5-38B (#25146) · a684c012
  Yan Ma authored Sep 19, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a684c012