Commits · 2e2000f352d861dd2b527a48c5f12d295a93c3dd · OpenDAS / vllm_cscc

21 Aug, 2025 6 commits

[Model] Add LFM2 architecture (#22845) · 2e2000f3
Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
2e2000f3

[Sampler] Support returning final logprobs (#22387) · f571ff8e

22quinn authored Aug 20, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

f571ff8e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c

Asaf Joseph Gardin authored Aug 21, 2025


Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>

3663870c

[CI/Build] Split out mm processor tests (#23260) · 2461d9e5
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
2461d9e5
[CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
7be5d113

20 Aug, 2025 15 commits
- Feature/mla tests (#23195) · 10cc12ba
  Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  10cc12ba
- [Fix] correct tool_id for kimi-k2 when use tool_choice=required (#21259) · 582bbe6b
  bigmoyan authored Aug 21, 2025
```
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  582bbe6b
- [Kernel/Quant] Remove the original marlin format and qqq (#23204) · 0cdbf5e6
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0cdbf5e6
- [torch.compile] Support conditional torch.compile per module (#22269) · dfd23820
  Yong Hoon Shin authored Aug 20, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  dfd23820
- [Misc] Add max_seq_len to CommonAttentionMetadata (#23216) · d6d13bd4
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d6d13bd4
- [Kernel] CUTLASS MoE FP8: Integrate cuda moe permute/unpermute (#23045) · b17109be
  shixianc authored Aug 20, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
```
  b17109be
- [Bugfix] Ensure correctness of HCXVision processing (#23254) · 44492358
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44492358
- [Fix] fix offline env use local mode path (#22526) · 38217877
  rongfu.leng authored Aug 20, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  38217877
- [Model][V1] Support Ernie MTP (#22169) · 7cd17e22
  xyxinyang authored Aug 20, 2025
```
Signed-off-by: zhouchong <zhouchong03@baidu.com>
Co-authored-by: zhouchong <zhouchong03@baidu.com>
```
  7cd17e22
- [Bugfix] Ensure correctness of Cohere2Vision processing (#23245) · 68fcd3fa
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68fcd3fa
- [Model] Support deepseek with eagle (#21086) · 83e69a09
  Xin Yang authored Aug 20, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  83e69a09
- [BugFix] Fix stuck stats/metrics after requests are aborted (#22995) · 8fd92092
  Nick Hill authored Aug 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8fd92092
- [CI/Build] Sync multimodal tests (#23181) · de7b67a0
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  de7b67a0
- [Doc] Update V1 status of various pooling models (#23189) · 64ab3c72
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64ab3c72
- [CI Perf] Only test bfloat16 for tests/compile/test_fusion_all_reduce.py (#23132) · d46d417b
  Michael Goin authored Aug 19, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d46d417b
19 Aug, 2025 14 commits
- [CI/Build] Replace lm-eval gsm8k tests with faster implementation (#23002) · 0f4f0191
  Michael Goin authored Aug 19, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0f4f0191
- [NVIDIA] Add SM100 Flashinfer Cutlass MoE fp8 backend (#22357) · a38b8af4
  amirkl94 authored Aug 20, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
```
  a38b8af4
- fix: use cache_salt for gpt-oss (#23186) · 80141bbf
  Marko Rosenmueller authored Aug 19, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  80141bbf
- [Frontend] Add `/collective_rpc` API endpoint (#23075) · f7cf5b51
  22quinn authored Aug 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f7cf5b51
- [CI/Build] Update transformers to v4.55.2 (#23093) · d6a1a209
  Isotr0py authored Aug 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d6a1a209
- Add return_token_ids parameter to OpenAI API endpoints (#22587) · 24f4d1a2
  Yuge Zhang authored Aug 20, 2025
```
Signed-off-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  24f4d1a2
- [FEAT] [Performance] Enable DP for ViT in Qwen2.5VL (#22742) · 1298c677
  TJian authored Aug 19, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1298c677
- [Model] support new model ovis2.5 (#23084) · b87cb97a
  myselvess authored Aug 19, 2025
```
Signed-off-by: myselvess <244285088@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b87cb97a
- [Model] Add multi_label_classification support (#23173) · f856c33c
  wang.yuqi authored Aug 19, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f856c33c
- [NVIDIA] Support Flashinfer TRTLLM FP8-q/kv/out Attention Kernel (#21716) · 03752dba
  elvischenv authored Aug 19, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  03752dba
- [Bugfix] Fix broken Minimax-01-VL model (#22116) · 31fd3265
  Isotr0py authored Aug 19, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  31fd3265
- [V0 Deprecation] Remove V0 FlashInfer attention backend (#22776) · 14006840
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  14006840
- [CI][V0 Deprecation] Removed V0 Only Chunked Prefill and Prefix Caching Tests (#22871) · 66032887
  Robert Shaw authored Aug 18, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  66032887
- [Spec Decode] Make `propose_draft_token_ids` non-blocking for lower TTFT (#23041) · c9b38be8
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c9b38be8
18 Aug, 2025 3 commits
- chore: remove unnecessary patch_padding_side for the chatglm model (#23090) · 569aefd1
  杨朱 · Kiki authored Aug 18, 2025
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  569aefd1
- [Bugfix] fix IntermediateTensors equal method (#23027) · 5a30bd10
  Ning Xie authored Aug 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5a30bd10
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
17 Aug, 2025 2 commits
- [Kernel] Add cuda kernel for gpt_oss activation (#22951) · 4d4061b6
  Jee Jee Li authored Aug 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d4061b6
- [Refactor] Defer tensor data construction in MultiModalKwargs (#23030) · 5c32143b
  Cyrus Leung authored Aug 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5c32143b