Commits · c42ff4f4fdc4a4d48ccef18b8067995f6c19e6ec · OpenDAS / vllm_cscc

29 Sep, 2025 2 commits
- [BugFix][torch.compile] KV scale calculation issues with FP8 quantization (#25513) · c42ff4f4
  Adrian Abeyta authored Sep 29, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  c42ff4f4
- [Misc] fix tests failure by using current_platform (#25825) · a3ae45a3
  Juechen Liu authored Sep 28, 2025
```
Signed-off-by: Juechen Liu <jueliu@meta.com>
```
  a3ae45a3
25 Sep, 2025 4 commits
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
- [torch.compile] Make Query Quantization Fusable (#24914) · 69a8c8e9
  Jonas M. Kübler authored Sep 25, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  69a8c8e9
- [XPU][Triton]add xpu config in triton_reshape_and_cache_flash (#25643) · d2af6744
  Kunshang Ji authored Sep 25, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  d2af6744
- [Kernel] Support DCP for Triton backend (#25132) · 05c19485
  Wei Wei authored Sep 24, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  05c19485
24 Sep, 2025 3 commits
- [V0 Deprecation] Remove unused classes in attention (#25541) · e6750d0b
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  e6750d0b
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050
- [V0 Deprecation] Remove max_seq_len_to_capture (#25543) · 2e19a848
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e19a848
23 Sep, 2025 5 commits
- Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7361ab37
- Fix triton_reshape_and_cache_flash.py triton import (#25522) · 4f2954f7
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4f2954f7
- [V0 Deprecation] Remove placeholder attn (#25510) · 969b4da3
  Thomas Parnell authored Sep 24, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  969b4da3
- [V1][Kernel] Add triton implementation for `reshape_and_cache_flash` (#24503) · 100b630a
  Burkhard Ringlein authored Sep 23, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chih-Chieh Yang <chih.chieh.yang@ibm.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  100b630a
- [Bugfix] Remove contiguous output req for context parallel MLA (#25414) · 78237e43
  Michael Goin authored Sep 22, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  78237e43
22 Sep, 2025 2 commits
- [Misc] Remove unused encoder-decoder error strings (#25374) · 417a164a
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  417a164a
- [V0 Deprecation] Remove `MultiModalPlaceholderMap` (#25366) · f92d9526
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f92d9526
21 Sep, 2025 3 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328) · 1cd885bd
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1cd885bd
- [V0 Deprecation] Remove V0 core (#25321) · c99db8c8
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c99db8c8
20 Sep, 2025 2 commits

[BUG FIX][NON-CUDA]quick fix to avoid call cudagraph_unsafe in attention (#25298) · 6c5f82e5
Chendi.Xue authored Sep 19, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
6c5f82e5

[torch.compile] CUDAGraph Inductor partition integration (#24281) · 8945b001

Boyuan Feng authored Sep 19, 2025


Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Signed-off-by: boyuanfeng <boyuan@meta.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8945b001

19 Sep, 2025 3 commits
- Optimize triton unified attention performance for sliding window attention (#24390) · a2a5f79e
  qizixi authored Sep 19, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  a2a5f79e
- Encoder model support for the Transformers backend (#25174) · 12aed7e4
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  12aed7e4
- [bugfix] fix MHA for models like OpenGVLab/InternVL3_5-38B (#25146) · a684c012
  Yan Ma authored Sep 19, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a684c012
18 Sep, 2025 2 commits
- [Kernel] Decouple Tile Size from Block Size in Triton Unified Attention Kernel (#21197) · 01a583fe
  jvlunteren authored Sep 18, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  01a583fe
- [XPU] Whisper model support on XPU Platform (#25123) · 3bc18127
  Chaojun Zhang authored Sep 18, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  3bc18127
17 Sep, 2025 1 commit

Aiter mha fp8 fix (#24991) · 1a456c7c

Douglas Lehr authored Sep 17, 2025


Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>

1a456c7c

16 Sep, 2025 2 commits
- Directly get max encoder len from VLLM config in V1 (#24866) · cd1f885b
  Sugar authored Sep 17, 2025
```
Signed-off-by: Sugar-zsg <952242923@qq.com>
```
  cd1f885b
- [Bug] Fix `is_flashmla_supported` Check Error (#24774) · b42566f4
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42566f4
15 Sep, 2025 1 commit
- [USAGE] Improve error handling for weight initialization in Unquantized… (#20321) · b834b4cb
  Rafael Marcelino Koike authored Sep 15, 2025
```
Signed-off-by: Rafael Marcelino Koike <rafael.koike@oracle.com>
Signed-off-by: Rafael Koike <koike.rafael@gmail.com>
```
  b834b4cb
12 Sep, 2025 3 commits
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
- [Multi Modal] Add FA3 in VIT (#24347) · 72fc8aa4
  Wenlong Wang authored Sep 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  72fc8aa4
11 Sep, 2025 3 commits

[Bugfix] Fix incorrect import of CacheConfig (#24631) · 6aeb1dab
Cyrus Leung authored Sep 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
6aeb1dab

[Model] New model support for Motif-1-Tiny (#23414) · 9bd831f5

TaehyunKim authored Sep 11, 2025


Signed-off-by: ca1207 <ca1207zzz@gmail.com>
Signed-off-by: TaehyunKim <73943231+ca1207@users.noreply.github.com>
Co-authored-by: WyldeCat <skan1543@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9bd831f5

[Bugfix] Add missing VIT backend dispatch on CPU (#24623) · 29799dda
Li, Jiang authored Sep 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
29799dda

10 Sep, 2025 3 commits

[torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767) · 9a161307

Gregory Shtrasberg authored Sep 10, 2025


Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9a161307

[v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
37e8182b

Feature/vit attention unification# 23880 (#23978) · 6cbd4190

baonudesifeizhai authored Sep 10, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

6cbd4190

09 Sep, 2025 1 commit

[Feature] Disallow FlashMLA on Blackwell (#24521) · 15de5ff9

Wentao Ye authored Sep 09, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

15de5ff9