Commits · 399d2a10e23fcf37cc7a703d7de50ffecc7e0c6f · OpenDAS / vllm_cscc

07 Aug, 2025 38 commits
- Fix pre-commit error in main (#22462) · 399d2a10
  Woosuk Kwon authored Aug 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  399d2a10
- [gpt-oss] Generate ResponseOutputItem from Harmony Message (#22410) · 4815b00f
  Chen Zhang authored Aug 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  4815b00f
- [Tool] Fix auto tool call (#22434) · 4da8bf20
  Chen Zhang authored Aug 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  4da8bf20
- [Bugfix] Add missing `packed_modules_mapping` to `DeepseekV2ForCausalLM` (#22352) · 7e0b1218
  fxmarty-amd authored Aug 07, 2025
```
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
```
  7e0b1218
- [Core] Store only the keys for multi-modal data in P0 (#22198) · 766bc816
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  766bc816
- [Docs] Update features/disagg_prefill, add v1 examples and development (#22165) · 289b18e6
  WeiQing Chen authored Aug 07, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  289b18e6
- [Doc] update docs for nightly benchmarks (#12022) · 35171b11
  Andrew Chan authored Aug 07, 2025
```
Signed-off-by: Andrew Chan <andrewkchan.akc@gmail.com>
```
  35171b11
- [Docs] Factor out troubleshooting to its own guide; add section for Ray Observability (#21578) · a2c6696b
  Ricardo Decal authored Aug 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  a2c6696b
- [Doc] Fix link to prefix caching design (#22384) · 5e839880
  Yong Hoon Shin authored Aug 07, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  5e839880
- [Misc] Enhance code formatting in mxfp4.py (#22423) · 136825de
  Woosuk Kwon authored Aug 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  136825de
- Add H20-3e fused MoE kernel tuning configs for GLM-4.5 (#22433) · c2dba2db
  JaceyShao authored Aug 07, 2025
```
Signed-off-by: shaojunqi <shaojunqi.sjq@alibaba-inc.com>
Co-authored-by: shaojunqi <shaojunqi.sjq@alibaba-inc.com>
```
  c2dba2db
- [Docs] Add missing dependency for docs build (#22435) · 434d2f3f
  Harry Mellor authored Aug 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  434d2f3f
- feat: Add --enable-log-outputs flag for logging model generations (#20707) · 8e8e0b6a
  Adrián García García authored Aug 07, 2025
```
Signed-off-by: Adrian Garcia <adrian.garcia@inceptionai.ai>
```
  8e8e0b6a
- [Misc] Support routing logic simulation (#21990) · 82216dc2
  Ming Yang authored Aug 06, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  82216dc2
- [Frontend] Update OpenAI error response to upstream format (#22099) · 37066185
  Moritz Sanft authored Aug 07, 2025
```
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
```
  37066185
- [Model] Switch to Fused RMS norm in Qwen2.5_VL model. (#22184) · cbc8457b
  vllmellm authored Aug 07, 2025
```
Signed-off-by: kf <kuanfu.liu@embeddedllm.com>
Signed-off-by: tjtanaavllm <tunjian.tan@amd.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: kf <kuanfu.liu@embeddedllm.com>
```
  cbc8457b
- [Bench] Split serve.py:main into async/async versions (#22405) · 4d4297e8
  lkchen authored Aug 06, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  4d4297e8
- [CI] Skip the pooling models that do not support transformers v4.55 (#22411) · 2a4c8255
  wang.yuqi authored Aug 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2a4c8255
- [Bugfix] EPLB load statistics problem (#22167) · 4be02a37
  WeiQing Chen authored Aug 07, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  4be02a37
- [gpt-oss] Convert user input to harmony format (#22402) · f6278b62
  Chen Zhang authored Aug 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f6278b62
- preload heavy modules when mp method is forkserver (#22214) · ad6c655d
  Lionel Villard authored Aug 06, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  ad6c655d
- Optimize logger init performance by using module-level constants (#22373) · 14bcf93a
  ZiTian.Zhao authored Aug 07, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  14bcf93a
- Update `hf_xet` pin to resolve hangs (#22356) · ecbea55c
  Harry Mellor authored Aug 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ecbea55c
- [Bugfix] Add proper comparison for package versions (#22314) · 609b533c
  Syed Muhammad Bin Asif authored Aug 07, 2025
```
Signed-off-by: Syed Muhammad Bin Asif <syedmba7@connect.hku.hk>
```
  609b533c
- [Bugfix]: Fix the streaming output for function calls in the minimax (#22015) · 5e9455ae
  qscqesze authored Aug 07, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  5e9455ae
- Use float32 for test_completion.py (#22385) · a00d8b23
  Michael Goin authored Aug 06, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  a00d8b23
- [Bugfix] Fix wrong method name in Intern-S1 image processor (#22417) · 04cf435d
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  04cf435d
- [Qwen3] Enable dual-chunk-attention support for Qwen3 models. (#21924) · 7377131a
  Tao He authored Aug 07, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  7377131a
- [XPU]Fix `flash_attn_varlen_func` interface on xpu (#22350) · 6b47ef24
  Kunshang Ji authored Aug 07, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6b47ef24
- [Attention] Support multiple attention metadata builders per kv_cache_spec +... · 1dc8a70b
  Lucas Wilkinson authored Aug 06, 2025
```
[Attention] Support multiple attention metadata builders per kv_cache_spec  + proper local attention no hybrid kv cache fix (#21588)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1dc8a70b
- Support encoder_only attention for FlexAttention (#22273) · f825c6bd
  Maximilien de Bayser authored Aug 06, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  f825c6bd
- [model] Support MiniCPM-V 4.0 (#22166) · 41b67f42
  tc-mb authored Aug 07, 2025
```
Co-authored-by: imning3 <hbning@pku.edu.cn>
```
  41b67f42
- Update `flashinfer-python==0.2.10` (#22389) · e8961e96
  Michael Goin authored Aug 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e8961e96
- Fix trtllm-gen attention env and add attention sink (#22378) · 9a3835aa
  Lain authored Aug 06, 2025
```
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: Lain <fusiyuan2000@hotmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
```
  9a3835aa
- [gpt-oss] fix model config with hf_config (#22401) · 5c7cc33f
  Yongye Zhu authored Aug 06, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  5c7cc33f
- [gpt-oss] add demo tool server (#22393) · 19c9365a
  Chen Zhang authored Aug 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  19c9365a
- [Bug] Fix B200 DeepGEMM E8M0 Accuracy Issue (#22399) · eec890c1
  Wentao Ye authored Aug 06, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eec890c1
- [v1] - Mamba1 Attention Metadata (#21249) · 46a13949
  Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  46a13949
06 Aug, 2025 2 commits

[gpt-oss] flashinfer mxfp4 (#22339) · 31f09c61

Yongye Zhu authored Aug 06, 2025


Signed-off-by: simon-mo <xmo@berkeley.edu>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>

31f09c61

[gpt-oss] Enhance error msg on attention sink init (#22335) · 31f5dc5b

Yongye Zhu authored Aug 06, 2025


Signed-off-by: simon-mo <xmo@berkeley.edu>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>

31f5dc5b