Commits · c2a8b08fcdc48579871cd568b0799037a1214ea1 · OpenDAS / vllm_cscc · GitLab

08 Sep, 2025 14 commits
- [Doc] Fix issues in integrations/llamastack.md (#24428) · c2a8b08f
  Michael Yao authored Sep 08, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c2a8b08f
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
- [Docs] Fix a tip indentation and typo (#24419) · 2f0b833a
  Michael Yao authored Sep 08, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  2f0b833a
- [gpt-oss][Responses API] Fix the function call id format (#24409) · 425b04b8
  Chauncey authored Sep 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  425b04b8
- [Model] Remove unnecessary CUDA sync of Qwen2VL image and video preprocess (#24334) · 60f0843e
  Chatcharin Sangbutsarakum authored Sep 08, 2025
```
Signed-off-by: Win <chatcharinsang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  60f0843e
- [Model] Remove unnecessary CUDA sync of GLM-4.1V image and video preprocess (#24332) · 8a466026
  Chatcharin Sangbutsarakum authored Sep 08, 2025
```
Signed-off-by: Win <chatcharinsang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  8a466026
- [P/D] Add a shutdown method to the Connector API (#22699) · 61aa4b29
  Chauncey authored Sep 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  61aa4b29
- [Doc] Fix UTF-8 encoding issues in documentation generation on Windows (#24361) · 8c892b18
  Al-Ekram Elahee Hridoy authored Sep 07, 2025
```
Signed-off-by: alekramelaheehridoy <aliqramalaheehridoy@gmail.com>
Signed-off-by: alekramelaheehridoy <alekramelaheehridoy@gmail.com>
Co-authored-by: alekramelaheehridoy <alekramelaheehridoy@gmail.com>
```
  8c892b18
- [CI/Build] Fix local image inputs in test_pixtral.py (#24401) · 3bca396f
  Chenheli Hua authored Sep 07, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  3bca396f
- [CI/Build] Disable flaky test_structured_output tests (#24404) · 3a3e91bd
  22quinn authored Sep 07, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  3a3e91bd
- [Sampler] Support returning all prompt logprobs (#23868) · b3d7e3c8
  Xingyu Liu authored Sep 07, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  b3d7e3c8
- [xpu] upgrade ipex/python3.12 for xpu (#23830) · 67841317
  Yan Ma authored Sep 08, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  67841317
- [Kernel] Support decode context parallelism on Blackwell with CUTLASS MLA (#24385) · 86173ad5
  Ming Yang authored Sep 07, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  86173ad5
- Add @luccafong to codeowner for spec decode (#24397) · 795b6951
  Lucia Fang authored Sep 07, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  795b6951
07 Sep, 2025 10 commits
- Skip MM Encoder for non-first PP ranks (#24387) · 2e5d2137
  Woosuk Kwon authored Sep 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e5d2137
- Add renderer-based prompt processing for embedding and classification endpoints (#24356) · 0661cb9d
  Flora Feng authored Sep 07, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0661cb9d
- [TPU] Remove TopKTopPSampler dependency for TPU sampler (#24391) · 105d3d62
  Woosuk Kwon authored Sep 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  105d3d62
- [Bugfix] Fix Qwen3-coder moe tuned config (#24072) · 62f66be1
  Jee Jee Li authored Sep 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  62f66be1
- [Misc] collect flashinfer version in collect_env.py (#24378) · 81c53ef5
  Ye (Charlotte) Qi authored Sep 06, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  81c53ef5
- QWEN3 Thinking Fused MoE kernels Optimization configs (#24330) · 75334956
  Saman A. Pour authored Sep 06, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
```
  75334956
- [Benchmark] add benchmark for custom activation op (#23908) · 77aec83b
  Jiangyun Zhu authored Sep 07, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  77aec83b
- [CI][Fix] deterministic seed for flaky CI runs on structured outputs (#24380) · e6759754
  Aaron Pham authored Sep 06, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  e6759754
- Migrate Qwen2 inputs to TensorSchema (#23475) · 37a6fa95
  Benji Beck authored Sep 06, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  37a6fa95
- [attention][DCP] use AttentionImpl.need_to_return_lse_for_decode (#24372) · 558f0907
  youkaichao authored Sep 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  558f0907
06 Sep, 2025 16 commits
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
- break execute_model in gpu_model_runner into sub-functions for custom scopes (#24265) · 848562bd
  Bangsheng Tang authored Sep 06, 2025
```
Co-authored-by: Bangsheng Tang <bangsheng@meta.com>
```
  848562bd
- [Bugfix] Fix unstable silu_mul+nvfp4 quant fusion test (#24370) · e68dc2f0
  elvischenv authored Sep 07, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  e68dc2f0
- [Frontend][Responses API] Support reporting tool output tokens and fix... · a3645ed9
  Ye (Charlotte) Qi authored Sep 06, 2025
```
[Frontend][Responses API] Support reporting tool output tokens and fix reasoning token count (#24285)
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a3645ed9
- [Fix] [gpt-oss] fix non-tool calling path for chat completion (#24324) · fb691ee4
  Aaron Pham authored Sep 06, 2025
  
  fb691ee4
- Lora bias(enable_lora_bias) deprecate warning (#24339) · 6024d115
  Ashwin Phadke authored Sep 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6024d115
- [Bugfix] Fix test_mixtral_moe (#24371) · 7555d6b3
  Jee Jee Li authored Sep 07, 2025
  
  7555d6b3
- [Bugfix] Fix broken deepseek fp8 TP weights loading (#24367) · 00a4e56d
  Isotr0py authored Sep 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  00a4e56d
- [Bugfix] Avoid uninitialized usage of azp_val when AZP is false. (#24335) · 0eadaeff
  mohankku authored Sep 06, 2025
```
Signed-off-by: Mohan Kumar Kumar <mohan.cbein@gmail.com>
Signed-off-by: mohankku <mohan.cbein@gmail.com>
```
  0eadaeff
- Add @benchislett to codeowner for spec decode and structured outputs (#24362) · 0077c863
  Benjamin Chislett authored Sep 06, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  0077c863
- [CI] Disable flaky structured output test from CI (#24366) · b121ca22
  Roger Wang authored Sep 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  b121ca22
- [Multimodal] Improve max video embedding length estimation in V1 (#24312) · eddaafc1
  Roger Wang authored Sep 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  eddaafc1
- refactor: Turn GPUModelRunner.inputs_embeds to a CpuGpuBuffer (#24345) · 305a1cc0
  Andrew Sansom authored Sep 06, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  305a1cc0
- [New Model]: google/embeddinggemma-300m (#24318) · 6d6c6b05
  wang.yuqi authored Sep 06, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6d6c6b05
- [Core] Allow disabling TP sharding for parallel Linear layer (#23024) · 53b19ccd
  Isotr0py authored Sep 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  53b19ccd
- [Bugfix] Catch and log invalid token ids in detokenizer (#24351) · 6432739e
  Nick Hill authored Sep 05, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  6432739e