Commits · 973c9d01da863cac9c51e8a5c0d390fc84b84fbc · OpenDAS / vllm_cscc

13 Sep, 2025 1 commit
- [Minor] Simplify duplicative device check for cuda (#24793) · 973c9d01
  Victor Ziliang Peng authored Sep 13, 2025
```
Signed-off-by: Ziliang Peng <ziliangdotme@gmail.com>
```
  973c9d01
12 Sep, 2025 2 commits
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
- [Multi Modal] Add FA3 in VIT (#24347) · 72fc8aa4
  Wenlong Wang authored Sep 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  72fc8aa4
11 Sep, 2025 2 commits
- [Bugfix][Attention] Fix FlashInfer MLA block size logic (#24692) · d4fd2768
  Matthew Bonanni authored Sep 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  d4fd2768
- [HybridKVCache][Platform] Add support_hybrid_kv_cache for platform (#24646) · 4f6593b0
  Mengqing Cao authored Sep 11, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  4f6593b0
10 Sep, 2025 6 commits
- [Kernel] Flashinfer MLA (trtllm-gen) decode kernel integration (#21078) · dcb28a33
  Hanjie Qiu authored Sep 10, 2025
```
Signed-off-by: hjjq <hanjieq@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  dcb28a33
- [Bugfix] Enable FP8 KV cache for FlashInfer and Triton backend on non-sm100 GPUs (#24577) · a0933c3b
  Thien Tran authored Sep 11, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  a0933c3b
- [rocm] enable torchao quantization for rocm (#24400) · d6069887
  Lifans authored Sep 10, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  d6069887
- Feature/vit attention unification# 23880 (#23978) · 6cbd4190
  baonudesifeizhai authored Sep 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6cbd4190
- [ROCm][Bugfix] Fix Aiter RMSNorm (#23412) · 7c195d43
  vllmellm authored Sep 10, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  7c195d43
- [Hardware][Apple-CPU] Enable native bfloat16 on Apple Silicon (M2 and later) (#24129) · 3c2156b3
  Ignacio Sica authored Sep 10, 2025
```
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
```
  3c2156b3
09 Sep, 2025 1 commit
- [Compilation][WideEP] Enable Piecewise CUDAGraph for DeepEPHT (#24123) · a55cf41a
  Wentao Ye authored Sep 09, 2025
  
  a55cf41a
06 Sep, 2025 1 commit
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
05 Sep, 2025 1 commit

[XPU][P/D] Add XPU support in NixlConnector (#22436) · e599e2c6

liuzhenwei authored Sep 05, 2025


Signed-off-by: zhenwei <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

e599e2c6

04 Sep, 2025 2 commits

[XPU] support Triton Attention backend on Intel GPU (#24149) · 16ded21e
Kunshang Ji authored Sep 04, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
16ded21e

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 2 commits
- [Attention] Blackwell FP8 MLA support with CUTLASS_MLA backend (#23289) · a7423220
  Matthew Bonanni authored Sep 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a7423220
- [XPU] Fix the bug of LoRA logits on the XPU platform (#24081) · 862f2ef8
  Chaojun Zhang authored Sep 03, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  862f2ef8
02 Sep, 2025 1 commit
- [XPU][Feature] fp8 online quantization support for XPU (#23148) · 7be0cb8e
  Yan Ma authored Sep 02, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  7be0cb8e
31 Aug, 2025 1 commit
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
29 Aug, 2025 1 commit
- [CPU] Enable data parallel for CPU backend (#23903) · ad39106b
  Li, Jiang authored Aug 29, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  ad39106b
27 Aug, 2025 1 commit
- [XPU] Add xpu torch.compile support (#22609) · fce10dbe
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  fce10dbe
25 Aug, 2025 1 commit
- [XPU] Delay BF16 check to worker init for spawn compatibility (#22979) · 8a044754
  Chaojun Zhang authored Aug 26, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  8a044754
23 Aug, 2025 1 commit

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527) · fa78de9d

Daifeng Li authored Aug 23, 2025


Signed-off-by: feng <fengli1702@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

fa78de9d

22 Aug, 2025 1 commit
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
19 Aug, 2025 3 commits
- [Hardware][IBM Z]Enable v1 for s390x and s390x dockerfile fixes (#22725) · 78dba404
  Nikhil Suryawanshi authored Aug 19, 2025
```
Signed-off-by: Nikhil Suryawanshi <suryawanshin74@gmail.com>
```
  78dba404
- [TPU] make ptxla not imported when using tpu_commons (#23081) · e9d6a3db
  Chengji Yao authored Aug 18, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>
```
  e9d6a3db
- [V0 Deprecation] Remove V0 FlashInfer attention backend (#22776) · 14006840
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  14006840
18 Aug, 2025 1 commit
- [Misc] refactor function name (#23029) · 08d5f711
  Ning Xie authored Aug 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  08d5f711
16 Aug, 2025 1 commit
- [XPU]avoid circular import during XPU init (#23017) · 7caec10e
  Kunshang Ji authored Aug 16, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7caec10e
15 Aug, 2025 1 commit

[Core] Allow full cudagraph with separate attention routines and orthogonal to... · 74f441f4

fhl2000 authored Aug 15, 2025


[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

74f441f4

14 Aug, 2025 1 commit

[Bugfix] use flash attn on sm90 (#22933) · 39cd09dc

Yongye Zhu authored Aug 14, 2025


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

39cd09dc

13 Aug, 2025 2 commits
- [Bugfix] Fix default enable for CUTLASS MLA on SM100 (#22738) · b1361c72
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b1361c72
- [V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6
  Woosuk Kwon authored Aug 12, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  71683ca6
12 Aug, 2025 1 commit
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908
06 Aug, 2025 1 commit

[ROCm] Add attention sink to use_rocm_custom_paged_attention (#22329) · 98a3a810

Woosuk Kwon authored Aug 05, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

98a3a810

05 Aug, 2025 1 commit
- [V1] port xformers backend to v1 (#21342) · 469b3ffa
  Giancarlo Delfin authored Aug 05, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  469b3ffa
04 Aug, 2025 1 commit
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
02 Aug, 2025 1 commit

[FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL... · d3a6f212

vllmellm authored Aug 02, 2025


[FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL models on ROCm platform. (#22069)
Signed-off-by: tjtanaavllm <tunjian.tan@amd.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: tjtanaavllm <tunjian.tan@amd.com>

d3a6f212

31 Jul, 2025 1 commit
- [UX] Rename CUTLASS_MLA_VLLM_V1 to CUTLASS_MLA (#21966) · 61445453
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  61445453