Commits · 8c546102658f97b10d13bcf25193b65edc6ea6ff · OpenDAS / vllm_cscc · GitLab

16 Sep, 2025 14 commits
- [Bug] [Spec Dec]: Fix kv_cache dtype mismatch for Eagle3 drafter on FP8 target (#24505) · 8c546102
  vllmellm authored Sep 16, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  8c546102
- [Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021) · 17871983
  cascade authored Sep 15, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  17871983
- Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
  Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  759ef49b
- [XPU] Fix circular import error. (#24927) · 5206ab20
  Kunshang Ji authored Sep 16, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  5206ab20
- Upgrade flashinfer to 0.3.1 (#24470) · 0af3ce13
  Lu Fang authored Sep 15, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  0af3ce13
- [Docs] Update instructions for how to using existing torch binary (#24892) · e1279ef0
  Richard Zou authored Sep 15, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e1279ef0
- [Metrics] Hide deprecated metrics with gpu_ prefix (#24245) · 2942970d
  Mark McLoughlin authored Sep 16, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  2942970d
- [CI] Small Accuracy Eval Test for Deepseek Model (#24259) · 3c96e7b8
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3c96e7b8
- [Bug] Fix `is_flashmla_supported` Check Error (#24774) · b42566f4
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42566f4
- Add pytest-cov and .coveragerc (#24778) · d96e1116
  Reza Barazesh authored Sep 15, 2025
```
Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
```
  d96e1116
- [ROCm][Bugfix] Fix the case where there's bias (#24895) · 2891603e
  Gregory Shtrasberg authored Sep 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  2891603e
- [Deprecation] Remove DeepGEMM Old Symbol Wrapper (#24902) · de2cc3d8
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  de2cc3d8
- Updated CODEOWNERS for flashinfer, mla, fused_moe (#24906) · e9508430
  Michael Goin authored Sep 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e9508430
- `HuggingFace` -> `Hugging Face` in `Integration with Hugging Face` docs (#24889) · 7f6f2c11
  Sergio Paniego Blanco authored Sep 16, 2025
  
  7f6f2c11
15 Sep, 2025 26 commits
- [Compile] Fix noop_elimination pass and add tests for noop_elimination (#24880) · 5bcc153d
  Jiangyun Zhu authored Sep 16, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  5bcc153d
- [Tests] fix initialization of kv hash in tests (#24273) · 45bfa49c
  Mickaël Seznec authored Sep 15, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  45bfa49c
- [ci] fix wheel names for arm wheels (#24898) · fd2f1054
  Simon Mo authored Sep 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  fd2f1054
- [Bug] Fix Cutlass Scaled MM Compilation Error (#24887) · e757a629
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e757a629
- [Performance] Remove redundant clone() calls in cutlass_mla (#24891) · aae725af
  Alexander Matveev authored Sep 15, 2025
  
  aae725af
- [gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still (#24759) · 73df49ef
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  73df49ef
- [gpt-oss] Add IncompleteDetails to ResponsesRepsonse (#24561) · 25aba2b6
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  25aba2b6
- Bump Flashinfer to 0.3.1 (#24868) · 94b03f88
  Benjamin Bartels authored Sep 15, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  94b03f88
- Update num_tokens_across_dp to use nccl instead of gloo (#24105) · 49bfc538
  Sage Moore authored Sep 15, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  49bfc538
- [Transform] Deterministic Hadacore Transforms (#24106) · a0b26701
  Kyle Sayers authored Sep 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  a0b26701
- Move `MultiModalConfig` from `config/__init__.py` to `config/multimodal.py` (#24659) · c4afdb69
  Harry Mellor authored Sep 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c4afdb69
- [USAGE] Improve error handling for weight initialization in Unquantized… (#20321) · b834b4cb
  Rafael Marcelino Koike authored Sep 15, 2025
```
Signed-off-by: Rafael Marcelino Koike <rafael.koike@oracle.com>
Signed-off-by: Rafael Koike <koike.rafael@gmail.com>
```
  b834b4cb
- Reinstate existing torch script (#24729) · 740f0647
  Harry Mellor authored Sep 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  740f0647
- Fp8 paged attention update (#22222) · 01413e0c
  xiao-llm authored Sep 15, 2025
```
Signed-off-by: Xiao Yu <xiao.yu@amd.com>
Signed-off-by: xiao-llm <xiao.yu.dc@outlook.com>
Co-authored-by: Xiao Yu <xiao.yu@metamaterial.com>
Co-authored-by: Xiao Yu <xiao.yu@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
```
  01413e0c
- [Bugfix] Fix GLM4.1V multimodal processor with compatability for Transformers v4.56 (#24822) · 0e219cd5
  Isotr0py authored Sep 15, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0e219cd5
- [Model]: support Ling2.0 (#24627) · 72c99f2a
  ant-yy authored Sep 15, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  72c99f2a
- [Misc] Fix examples openai_pooling_client.py (#24853) · bf214ca2
  wang.yuqi authored Sep 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bf214ca2
- [XPU] Set consistent default KV cache layout (#24745) · 2e41f5ab
  Nicolò Lucchesi authored Sep 15, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2e41f5ab
- [UT] enhance free kv cache block queue popleft_n (#24220) · bc0f6059
  Ning Xie authored Sep 15, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  bc0f6059
- [P/D]`kv_output_aggregator` support P TP > D TP (#23917) · 8de261b0
  Chao Lei authored Sep 15, 2025
```
Signed-off-by: LCAIZJ <leichao139636@163.com>
Co-authored-by: leichao.lc <leichao.lc@antgroup.com>
```
  8de261b0
- [Misc] Own KVConnectors installation (#24867) · a0d8b973
  Nicolò Lucchesi authored Sep 15, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a0d8b973
- [Misc] rename interval to max_recent_requests (#24229) · 59e17dd4
  Ning Xie authored Sep 15, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  59e17dd4
- [Doc]: fix typos in various files (#24821) · 4979eb79
  Didier Durand authored Sep 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  4979eb79
- [Bugfix] MiDashengLM model contact error under concurrent testing (#24738) · a8c0f599
  bingchen-mi authored Sep 15, 2025
```
Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
```
  a8c0f599
- [Frontend] Skip `stop` in reasoning content (#14550) · f4a948f3
  Ce Gao authored Sep 15, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  f4a948f3
- [kv cache] update num_free_blocks in the end (#24228) · 3f331398
  Ning Xie authored Sep 15, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3f331398