Commits · 14006840eacf74f83e0d486eca6a24e75cafa6d3 · OpenDAS / vllm_cscc

19 Aug, 2025 3 commits
- [V0 Deprecation] Remove V0 FlashInfer attention backend (#22776) · 14006840
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  14006840
- [CI][V0 Deprecation] Removed V0 Only Chunked Prefill and Prefix Caching Tests (#22871) · 66032887
  Robert Shaw authored Aug 18, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  66032887
- [Spec Decode] Make `propose_draft_token_ids` non-blocking for lower TTFT (#23041) · c9b38be8
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c9b38be8
18 Aug, 2025 3 commits
- chore: remove unnecessary patch_padding_side for the chatglm model (#23090) · 569aefd1
  杨朱 · Kiki authored Aug 18, 2025
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  569aefd1
- [Bugfix] fix IntermediateTensors equal method (#23027) · 5a30bd10
  Ning Xie authored Aug 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5a30bd10
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
17 Aug, 2025 2 commits
- [Kernel] Add cuda kernel for gpt_oss activation (#22951) · 4d4061b6
  Jee Jee Li authored Aug 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d4061b6
- [Refactor] Defer tensor data construction in MultiModalKwargs (#23030) · 5c32143b
  Cyrus Leung authored Aug 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5c32143b
16 Aug, 2025 11 commits

[V1] Logits processors extensibility (#19912) · bf7f470b

afeldman-nm authored Aug 16, 2025


Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: Andrew Feldman <afeld2012@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf7f470b

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

[Flaky CI] Increase timeout tolerance for... · 3253ae76

Michael Goin authored Aug 16, 2025


[Flaky CI] Increase timeout tolerance for test_mp_crash_detection+test_default_mm_lora_chat_completions (#23028)
Signed-off-by: mgoin <mgoin64@gmail.com>

3253ae76

[Frontend] Added support for HermesToolParser for models without special tokens (#16890) · 68373d31
Woonggi Min authored Aug 17, 2025
```
Signed-off-by: minpeter <kali2005611@gmail.com>
```
68373d31
[New Model]mBART model (#22883) · 829bbd78
汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
829bbd78
[Refactor] Allow optional MultiModalKwargsItem in IPC (#23022) · 4dff91c9
Cyrus Leung authored Aug 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
4dff91c9
[CI][Bugfix] Skip Ovis2 generation test because of broken remote code (#22954) · 2dbccce8
Isotr0py authored Aug 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
2dbccce8
[Multimodal] Update Tensor schema test to cover arbitrary shape mm inputs (#22867) · cc826a20
Isotr0py authored Aug 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
cc826a20

[BugFix] Add support for loading prompt embeds tensors serialized on... · 78863f8c

Andrew Sansom authored Aug 16, 2025


[BugFix] Add support for loading prompt embeds tensors serialized on unavailable devices and sparse tensors (#22962)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>

78863f8c

[V1] support min_tokens for detokener (#22014) · e4e37ded

Calvin Chen authored Aug 16, 2025


Signed-off-by: calvin chen <wen.chen@dynamia.ai>
Co-authored-by: Nick Hill <nhill@redhat.com>

e4e37ded

[Misc] Support passing multiple request ids at once to `AsyncLLM.abort()` (#22944) · ad0297d1
Nick Hill authored Aug 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
ad0297d1

15 Aug, 2025 21 commits
- Support multiple attention groups for KV sharing (#22672) · 3e2f7985
  Yong Hoon Shin authored Aug 15, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  3e2f7985
- [v1] Move block_hashes from KVCacheManager to Request.block_hashes (#19728) · c280066f
  Or Ozeri authored Aug 16, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c280066f
- [BugFix] Handle case where async utility call is cancelled (#22996) · b9dc9d26
  Nick Hill authored Aug 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Yinghai Lu <yinghai@thinkingmachines.ai>
```
  b9dc9d26
- minor: zero workspace buffer init for flashinfer trtllm-gen attn (#22603) · 1723ef1a
  eigen authored Aug 15, 2025
  
  1723ef1a
- [CI] Speed up Whisper tests by reusing server (#22859) · 8a87cd27
  Michael Goin authored Aug 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8a87cd27
- [Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra... · 8ad7285e
  bnellnm authored Aug 15, 2025
```
[Kernels] Clean up FusedMoeMethodBase and modular kernel setup.  Remove extra arguments from modular kernel methods. (#22035)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  8ad7285e
- [Core] Allow full cudagraph with separate attention routines and orthogonal to... · 74f441f4
  fhl2000 authored Aug 15, 2025
```
[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  74f441f4
- [CI] Remove duplicated docs build from buildkite (#22924) · e8b40c7f
  Harry Mellor authored Aug 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8b40c7f
- [V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c
  Thomas Parnell authored Aug 15, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  75531a6c
- Improve multimodal hasher performance for re-used Image prompts (#22825) · 22341b99
  Staszek Paśko authored Aug 15, 2025
```
Signed-off-by: Staszek Pasko <staszek@gmail.com>
```
  22341b99
- [Bugfix] Unquote file uri before reading image (#22912) · aa300c43
  Sayandip Dutta authored Aug 15, 2025
```
Signed-off-by: Sayandip Dutta <sayandip199309@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  aa300c43
- [V1] - Split Prefill and Decode for Mamba1 models (#22653) · fe91ce95
  amirai21 authored Aug 15, 2025
```
Signed-off-by: amirk <amirk@ai21.com>
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
Co-authored-by: Asaf Joseph Gardin <39553475+Josephasafg@users.noreply.github.com>
```
  fe91ce95
- [CI] Pooling models mteb test uses enforce_eager (#22878) · 5406ebf5
  wang.yuqi authored Aug 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  5406ebf5
- [Mamba] - refactor: Renamed mamba_attn to mamba2_attn (#22818) · 3d232dbd
  Asaf Joseph Gardin authored Aug 15, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  3d232dbd
- [Feature] Full Cuda Graph Support for Cutlass MLA and 6% E2E Throughput Improvement (#22763) · 5c3fbfe4
  Wentao Ye authored Aug 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5c3fbfe4
- [CI Perf] Prune tests in `tests/kernels/attention/` (#22936) · 0fe85087
  Michael Goin authored Aug 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0fe85087
- [CI Perf] Prune tests in `tests/kernels/moe/` (#22939) · d2b0e97e
  Michael Goin authored Aug 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d2b0e97e
- [CI Perf] Prune tests in `tests/kernels/quantization/` (#22942) · 590bddbf
  Michael Goin authored Aug 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  590bddbf
- [BugFix] Fix port lookup in internal DP LB tests (#22252) · ae05a6d8
  Nick Hill authored Aug 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ae05a6d8
- Revert "[Kernel] Add cuda kernel for gpt_oss activation" (#22948) · f1f0d2fa
  Simon Mo authored Aug 14, 2025
  
  f1f0d2fa
- [Kernel] Add cuda kernel for gpt_oss activation (#22538) · 81f4b964
  Jee Jee Li authored Aug 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  81f4b964