Commits · e58c5a97688750e7930f13b6fe556d9a28a5b2d9 · OpenDAS / vllm_cscc

"tests/entrypoints/openai/responses/test_harmony.py" did not exist on "53a56e658b9ab1eabb7339d3001dc3fd9178dd21"

19 Aug, 2025 13 commits
- [NVIDIA] Add SM100 Flashinfer Cutlass MoE fp8 backend (#22357) · a38b8af4
  amirkl94 authored Aug 20, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
```
  a38b8af4
- [Bugfix] Fix accuracy issue when using flashinfer cutlass moe, TP=1 and modelopt. (#23125) · b94faf9d
  bnellnm authored Aug 19, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b94faf9d
- Migrate LlavaOnevisionMultiInputs to TensorSchema (#21844) · a70d0bd0
  Benji Beck authored Aug 19, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a70d0bd0
- [Model] Removes redundant all-reduce operation in Qwen3MoeSparseMoeBlock (#23169) · 4f510bc2
  yiz-liu authored Aug 20, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
  4f510bc2
- [FEAT] [Performance] Enable DP for ViT in Qwen2.5VL (#22742) · 1298c677
  TJian authored Aug 19, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1298c677
- [Model] support new model ovis2.5 (#23084) · b87cb97a
  myselvess authored Aug 19, 2025
```
Signed-off-by: myselvess <244285088@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b87cb97a
- [Model] Add multi_label_classification support (#23173) · f856c33c
  wang.yuqi authored Aug 19, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f856c33c
- [bug fix] Fix llama4 spec decoding (#22691) · 5bfe0dea
  qizixi authored Aug 19, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  5bfe0dea
- [Bugfix] Fix broken Minimax-01-VL model (#22116) · 31fd3265
  Isotr0py authored Aug 19, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  31fd3265
- Fix GLM-4.5V-FP8 numerical issue (#22949) · 4efd43e9
  qizixi authored Aug 19, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  4efd43e9
- [Model] Support Pipeline Parallelism for moonshotai/Kimi-VL-A3B-Thinking-2506 (#23114) · fda9537c
  Jiangyun Zhu authored Aug 19, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  fda9537c
- Migrate InternVLImagePixelInputs (in nemotron_vl.py) to TensorSchema (#22023) · e75f3422
  Benji Beck authored Aug 18, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e75f3422
- [TPU] make ptxla not imported when using tpu_commons (#23081) · e9d6a3db
  Chengji Yao authored Aug 18, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>
```
  e9d6a3db
18 Aug, 2025 5 commits
- Use Blackwell FlashInfer MXFP4 MoE by default if available (#23008) · 6d25e3fd
  Michael Goin authored Aug 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6d25e3fd
- [Bugfix] Support compile for Transformers multimodal (#23095) · 0e3bb543
  Raushan Turganbay authored Aug 18, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  0e3bb543
- [Refactor] Get prompt updates earlier (#23097) · d3f71f12
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d3f71f12
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
- [Bugfix] fix Qwen2.5-Omni processor output mapping (#23058) · 9f1c6422
  double7 authored Aug 18, 2025
```
Signed-off-by: double7 <33449816+DoubleVII@users.noreply.github.com>
Co-authored-by: 杨森 <yangsen.double7@bytedance.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9f1c6422
17 Aug, 2025 7 commits
- fix: gptq marlin weight loading failure (#23066) · 0fc8fa75
  Simon Mo authored Aug 17, 2025
  
  0fc8fa75
- [Misc] Remove dead return (#23061) · c55bc1db
  Woosuk Kwon authored Aug 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c55bc1db
- [Bugfix] should use stack instead of concat (#22972) · fe0411fc
  947132885 authored Aug 17, 2025
```
Signed-off-by: 947132885 <947132885@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  fe0411fc
- [Kernel] Add cuda kernel for gpt_oss activation (#22951) · 4d4061b6
  Jee Jee Li authored Aug 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d4061b6
- [Refactor] Defer tensor data construction in MultiModalKwargs (#23030) · 5c32143b
  Cyrus Leung authored Aug 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5c32143b
- [UX] Separate marlin moe config logic from triton moe (#23006) · 94096a47
  Michael Goin authored Aug 16, 2025
  
  94096a47
- [Bugfix] fix qwen3 moe fp8 accuracy issue (#23031) · a258ad8b
  Jinzhen Lin authored Aug 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
  a258ad8b
16 Aug, 2025 4 commits
- [Kernel/Quant] Remove AQLM (#22943) · 4fc722ec
  Michael Goin authored Aug 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  4fc722ec
- [New Model]mBART model (#22883) · 829bbd78
  汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  829bbd78
- [Multimodal] Update Tensor schema test to cover arbitrary shape mm inputs (#22867) · cc826a20
  Isotr0py authored Aug 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cc826a20
- [Bugfix] Fix DeepSeek MTP (#22934) · fbd88728
  Benjamin Chislett authored Aug 15, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  fbd88728
15 Aug, 2025 11 commits

[BugFix] Fix regression caused by mamba state dtype PR (#22998) · f5d412ba
Thomas Parnell authored Aug 16, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
f5d412ba
[Model] Granite-4 support loading quantized checkpoint (#22925) · 6cd69f51
Chih-Chieh Yang authored Aug 15, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
6cd69f51

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra... · 8ad7285e

bnellnm authored Aug 15, 2025


[Kernels] Clean up FusedMoeMethodBase and modular kernel setup.  Remove extra arguments from modular kernel methods. (#22035)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

8ad7285e

[BugFix] Skip the Q component for QKVParallelLinear in the case of... · 6b04039a

sstamenk authored Aug 15, 2025


[BugFix] Skip the Q component for QKVParallelLinear in the case of QKVCrossParallelLinear since its width is 0 (#22369)
Signed-off-by: sstamenk <sstamenk@amd.com>

6b04039a

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c

Thomas Parnell authored Aug 15, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

75531a6c

[V1] - Split Prefill and Decode for Mamba1 models (#22653) · fe91ce95

amirai21 authored Aug 15, 2025


Signed-off-by: amirk <amirk@ai21.com>
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
Co-authored-by: Asaf Joseph Gardin <39553475+Josephasafg@users.noreply.github.com>

fe91ce95

Revert "[ROCm][AITER] Support AITER Rope ops in RotaryEmbedding Module." (#22956) · b2f6c247
TJian authored Aug 14, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
b2f6c247
[Mamba] - refactor: Renamed mamba_attn to mamba2_attn (#22818) · 3d232dbd
Asaf Joseph Gardin authored Aug 15, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
3d232dbd

refactor: Change scaling factors calculation for flashinfer FusedMoE (#22812) · b4cef5e6

amirkl94 authored Aug 15, 2025


Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

b4cef5e6

Revert "[Kernel] Add cuda kernel for gpt_oss activation" (#22948) · f1f0d2fa
Simon Mo authored Aug 14, 2025

f1f0d2fa
[Kernel] Add cuda kernel for gpt_oss activation (#22538) · 81f4b964
Jee Jee Li authored Aug 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
81f4b964