Commits · 1dc8a70b6d4e8ba4e139f1ddb86a166694f42f21 · OpenDAS / vllm_cscc

"vllm/model_executor/models/phimoe.py" did not exist on "8678a69ab51956031e3bb70bdf1a781a8652e67d"

07 Aug, 2025 1 commit

[Attention] Support multiple attention metadata builders per kv_cache_spec +... · 1dc8a70b

Lucas Wilkinson authored Aug 06, 2025


[Attention] Support multiple attention metadata builders per kv_cache_spec  + proper local attention no hybrid kv cache fix (#21588)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

1dc8a70b

06 Aug, 2025 3 commits

[Bugfix] Make condition in triton kernel constexpr (#22370) · 2435ea7e
Gregory Shtrasberg authored Aug 06, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
2435ea7e

[BugFix] Fix triton compile error in `kernel_unified_attention_2/3d` caused by... · 4a6b72c2

Lucas Wilkinson authored Aug 06, 2025


[BugFix] Fix triton compile error in `kernel_unified_attention_2/3d` caused by attention sinks (#22368)
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>

4a6b72c2

Add attention sink in attention backends (#22320) · 6e209243

Woosuk Kwon authored Aug 05, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

6e209243

05 Aug, 2025 2 commits
- [NVIDIA] Support Flashinfer TRT-LLM Prefill Attention Kernel (#22095) · 83156c7b
  elvischenv authored Aug 05, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  83156c7b
- [UX] Fail if an invalid attention backend is specified (#22217) · e79a12fc
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  e79a12fc
04 Aug, 2025 1 commit
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
01 Aug, 2025 1 commit
- [Bugfix] Check NVIDIA artifactory is accessible before using flashinfer cubin kernels (#21893) · f81c1bb0
  Michael Goin authored Aug 01, 2025
  
  f81c1bb0
29 Jul, 2025 1 commit
- [Bugfix] Fix workspace buffer None issue for Flashinfer TRTLLM Backend (#21525) · 58b11b24
  elvischenv authored Jul 29, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  58b11b24
24 Jul, 2025 1 commit
- update flashinfer to v0.2.9rc1 (#21485) · 2dd72d23
  weiliang authored Jul 25, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
```
  2dd72d23
23 Jul, 2025 2 commits
- [V1] Fix local chunked attention always disabled (#21419) · 78c13e30
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  78c13e30
- [Bugfix][Qwen][DCA] fixes bug in dual-chunk-flash-attn backend for qwen 1m models. (#21364) · 7c734ee0
  Tao He authored Jul 23, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  7c734ee0
21 Jul, 2025 1 commit

[Attention] Clean up iRoPE in V1 (#21188) · 304dce7e

Lucas Wilkinson authored Jul 21, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

304dce7e

19 Jul, 2025 2 commits
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14
  Lucia Fang authored Jul 19, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>
```
  9a9fda14
18 Jul, 2025 2 commits
- [Bugfix] Voxtral on Blackwell GPUs (RTX 50 series) (#21077) · 5782581a
  hax0r31337 authored Jul 19, 2025
```
Signed-off-by: hax0r31337 <liulihaocaiqwq@gmail.com>
```
  5782581a
- [Kernel] Apply torch.Tag.needs_fixed_stride_order only for torch==2.6.0 (#19346) · b2eb2b5a
  Richard Zou authored Jul 18, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  b2eb2b5a
17 Jul, 2025 1 commit
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
16 Jul, 2025 1 commit
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
15 Jul, 2025 1 commit
- [MISC] Add init files for python package (#20908) · 20149d84
  Li Wang authored Jul 15, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  20149d84
14 Jul, 2025 1 commit
- [Misc] Log the reason for falling back to FlexAttention (#20699) · e8cc53af
  Cyrus Leung authored Jul 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e8cc53af
13 Jul, 2025 1 commit
- [Refactor] Change the way of import triton (#20774) · c1acd6d7
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c1acd6d7
12 Jul, 2025 1 commit
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
11 Jul, 2025 3 commits
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  31d5c179
- [Attention] MLA - Flashinfer Ragged Prefill (#20034) · 5b032352
  Alexander Matveev authored Jul 10, 2025
  
  5b032352
08 Jul, 2025 1 commit
- [CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560) · 7721ef17
  Li, Jiang authored Jul 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7721ef17
07 Jul, 2025 1 commit
- [Kernel] Optimize Prefill Attention in Unified Triton Attention Kernel (#20308) · 22dd9c27
  jvlunteren authored Jul 07, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  22dd9c27
06 Jul, 2025 2 commits

[V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9fb52e52

[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27

Woosuk Kwon authored Jul 06, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

e202dd27

02 Jul, 2025 1 commit
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
27 Jun, 2025 1 commit
- Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143) · dec197e3
  Chendi.Xue authored Jun 27, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  dec197e3
26 Jun, 2025 3 commits
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1
- [Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local... · 27c065df
  TJian authored Jun 26, 2025
```
[Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local Attention Logic: affecting Llama4) (#19904)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  27c065df
25 Jun, 2025 1 commit
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
20 Jun, 2025 2 commits
- [Kernel] mark TorchSDPABackend swap_blocks NotImplementedError (#19749) · 71baf85a
  Ning Xie authored Jun 21, 2025
  
  71baf85a
- [Kernel] correct cpu worker function parameter type (#19745) · 71d12195
  Ning Xie authored Jun 20, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  71d12195
18 Jun, 2025 2 commits
- [Minor] Zero-initialize attn output buffer (#19784) · f04d6045
  Woosuk Kwon authored Jun 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f04d6045
- [MISC] correct copy_blocks src_to_dists param type (#19696) · c53711bd
  Ning Xie authored Jun 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c53711bd