Commits · 47604137a26f825295e6e9cc7314dea2bd4f7eef · OpenDAS / vllm_cscc

"llama.cpp/vscode:/vscode.git/clone" did not exist on "46168259831650c2cdbfc9b356ccf3064085e822"

03 Nov, 2025 1 commit
- [Bugfix][Qwen][Multimodal] Move Qwen2_5_vl sdpa to custom op and reenable compile (#27764) · 55011aef
  Lucas Kabela authored Nov 03, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  55011aef
01 Nov, 2025 1 commit

[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5

Yan Ma authored Nov 01, 2025


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

7e2729b5

28 Oct, 2025 1 commit

[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic... · 94666612

Lucas Kabela authored Oct 28, 2025


[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic nn.Module and demonstrate speedup on Qwen Vision model (#23207)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Signed-off-by: Lucas Kabela <lucasakabela@gmail.com>

94666612

26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

21 Oct, 2025 1 commit

[Bugfix] fixes the decoding metadata of dense mla's fp8 kvcache. (#27144) · 250fb1b8

Tao He authored Oct 22, 2025


Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

250fb1b8

18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
14 Oct, 2025 1 commit

[DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d

Jaya Yuan authored Oct 14, 2025


Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>

ea97940d

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
11 Oct, 2025 1 commit
- CP: make correct_attn_out robust to 4‑D views and fix Triton arg binding (#26509) · 0cd103e7
  Huamin Li authored Oct 11, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  0cd103e7
08 Oct, 2025 1 commit
- [Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125) · f80e7866
  Lucas Wilkinson authored Oct 07, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  f80e7866
06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 3 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
30 Sep, 2025 2 commits

[bugfix][deepseek] fix flashmla kernel selection (#25956) · a2e6fa7e
youkaichao authored Oct 01, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
a2e6fa7e

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

29 Sep, 2025 1 commit
- [Misc] fix tests failure by using current_platform (#25825) · a3ae45a3
  Juechen Liu authored Sep 28, 2025
```
Signed-off-by: Juechen Liu <jueliu@meta.com>
```
  a3ae45a3
25 Sep, 2025 2 commits
- [XPU][Triton]add xpu config in triton_reshape_and_cache_flash (#25643) · d2af6744
  Kunshang Ji authored Sep 25, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  d2af6744
- [Kernel] Support DCP for Triton backend (#25132) · 05c19485
  Wei Wei authored Sep 24, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  05c19485
24 Sep, 2025 1 commit
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050
23 Sep, 2025 3 commits
- Fix triton_reshape_and_cache_flash.py triton import (#25522) · 4f2954f7
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4f2954f7
- [V1][Kernel] Add triton implementation for `reshape_and_cache_flash` (#24503) · 100b630a
  Burkhard Ringlein authored Sep 23, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chih-Chieh Yang <chih.chieh.yang@ibm.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  100b630a
- [Bugfix] Remove contiguous output req for context parallel MLA (#25414) · 78237e43
  Michael Goin authored Sep 22, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  78237e43
19 Sep, 2025 1 commit
- Optimize triton unified attention performance for sliding window attention (#24390) · a2a5f79e
  qizixi authored Sep 19, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  a2a5f79e
18 Sep, 2025 1 commit
- [Kernel] Decouple Tile Size from Block Size in Triton Unified Attention Kernel (#21197) · 01a583fe
  jvlunteren authored Sep 18, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  01a583fe
17 Sep, 2025 1 commit

Aiter mha fp8 fix (#24991) · 1a456c7c

Douglas Lehr authored Sep 17, 2025


Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>

1a456c7c

10 Sep, 2025 1 commit

[torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767) · 9a161307

Gregory Shtrasberg authored Sep 10, 2025


Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9a161307

06 Sep, 2025 2 commits

[V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
4172235a

[Feature] Support Decode Context Parallel (DCP) for MLA (#23734) · ac201a0e

yzds authored Sep 06, 2025


Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: youkaichao <youkaichao@gmail.com>

ac201a0e

04 Sep, 2025 1 commit
- [XPU] support Triton Attention backend on Intel GPU (#24149) · 16ded21e
  Kunshang Ji authored Sep 04, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  16ded21e
03 Sep, 2025 1 commit
- [Bugfix] Fixing division by zero in triton_attn if query_heads/kv_heads > 16 (#23424) · 6d80ae83
  Burkhard Ringlein authored Sep 03, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
```
  6d80ae83
02 Sep, 2025 1 commit
- [AMD][Kernel][Bugfix] Cast offsets tensor bn to tl.int64 to avoid GPU segfault (#23692) · 457e4719
  rasmith authored Sep 02, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  457e4719
22 Aug, 2025 1 commit
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
13 Aug, 2025 1 commit
- Remove unneeded ROCm platform import when using CUDA (#22765) · 4082338a
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4082338a
10 Aug, 2025 1 commit

[TPU] kv cache update kernel doesn't need to be padded slices to multiple of... · 2a84fb42

Chengji Yao authored Aug 09, 2025


[TPU] kv cache update kernel doesn't need to be padded slices to multiple of num_slices_per_block (#22394)
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>

2a84fb42

08 Aug, 2025 1 commit

[BugFix] Fix IMA FlashMLA full cuda-graph and DP + Update FlashMLA (#21691) · cd9b9de1

Lucas Wilkinson authored Aug 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

cd9b9de1

07 Aug, 2025 1 commit
- [Bugfix] Add proper comparison for package versions (#22314) · 609b533c
  Syed Muhammad Bin Asif authored Aug 07, 2025
```
Signed-off-by: Syed Muhammad Bin Asif <syedmba7@connect.hku.hk>
```
  609b533c
06 Aug, 2025 3 commits

[Bugfix] Make condition in triton kernel constexpr (#22370) · 2435ea7e
Gregory Shtrasberg authored Aug 06, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
2435ea7e

[BugFix] Fix triton compile error in `kernel_unified_attention_2/3d` caused by... · 4a6b72c2

Lucas Wilkinson authored Aug 06, 2025


[BugFix] Fix triton compile error in `kernel_unified_attention_2/3d` caused by attention sinks (#22368)
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>

4a6b72c2

Add attention sink in attention backends (#22320) · 6e209243

Woosuk Kwon authored Aug 05, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

6e209243