Commits · 846197f505fb7b7861a9688e2a09b514b9d3133d · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "eebf00cb0c925404672d407674b319ebc5ae3a84"

23 Sep, 2025 36 commits
- [Log] Optimize kv cache memory log from Bytes to GiB (#25204) · 846197f5
  Wentao Ye authored Sep 23, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  846197f5
- [BugFix] Fix UB in per_token_group_quant.cu (#24913) · 2357480b
  rivos-shreeasish authored Sep 23, 2025
```
Signed-off-by: Shreeasish Kumar <shreeasish@rivosinc.com>
```
  2357480b
- [Kernels] Support blocked fp8 quantization for compressed tensors MoE (#25219) · f11e3c51
  bnellnm authored Sep 23, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f11e3c51
- Add backward compatibility for `GuidedDecodingParams` (#25422) · 875d6def
  Harry Mellor authored Sep 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  875d6def
- [Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845) · cc1dc7ed
  Lucas Wilkinson authored Sep 23, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  cc1dc7ed
- [V1] Remove V0 code paths for Hybrid models (#25400) · a903669e
  Thomas Parnell authored Sep 23, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  a903669e
- [UX] Change kv-cache-memory log level to debug (#25479) · 2c58742d
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  2c58742d
- [XPU] Fix MOE DP accuracy issue on XPU (#25465) · 4c966e44
  Fanli Lin authored Sep 23, 2025
  
  4c966e44
- [Docs] NixlConnector quickstart guide (#24249) · da5e7e43
  Peter Pan authored Sep 23, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Signed-off-by: Nicolò Lucchesi<nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  da5e7e43
- [P/D] Support NIXL connector to disconnect during a clean shutdown (#24423) · f05a4f0e
  Chauncey authored Sep 23, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  f05a4f0e
- [BugFix] Register expert_map as named buffer for wake_up and sleep (#25458) · 61d1b355
  Joel authored Sep 23, 2025
```
Signed-off-by: wuxibin <wuxibin@bytedance.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  61d1b355
- [CI/Build] Fix disabled v1 attention backend selection test (#25471) · b6a136b5
  Isotr0py authored Sep 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b6a136b5
- [docs] Benchmark Serving Incorrect Arg (#25474) · 0d9fe260
  vllmellm authored Sep 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  0d9fe260
- [Core] Optimize LoRA weight loading (#25403) · 273690a5
  Jee Jee Li authored Sep 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  273690a5
- [Bugfix] Fix idefics3 `tie_word_embeddings` (#25454) · 231c2c63
  Isotr0py authored Sep 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  231c2c63
- [Test]: Hermes tool parser stream output error in Qwen3 case (#25203) · 4322c553
  Andreas Hartel authored Sep 23, 2025
```
Signed-off-by: Andreas Hartel <andreas.hartel@aleph-alpha.com>
```
  4322c553
- [Misc] Move DP for ViT code inside model executor dir (#25459) · babad6e5
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  babad6e5
- [Frontend] Add a new xml-based tool parser for qwen3-coder (#25028) · 9383cd6f
  Zhikaiiii authored Sep 23, 2025
```
Signed-off-by: Zhikaiiii <1658973216@qq.com>
```
  9383cd6f
- Handle triton kernel import exception (#25319) · ba8d2165
  Ming Yang authored Sep 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  ba8d2165
- [Model] Enable DP for ViT in Qwen2-VL (#25445) · c98be0a2
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c98be0a2
- [NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) · 5774b0a1
  Chendi.Xue authored Sep 22, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  5774b0a1
- [DP/EP][GPTOSS] Use triton matmul-ogs kernels for GPTOSS DP/EP (#24588) · e8db44f8
  Varun Sundar Rabindranath authored Sep 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e8db44f8
- [Docs] Fix griffe warnings in vllm/lora/ops (#25369) · fafbe11a
  Michael Yao authored Sep 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  fafbe11a
- [Bugfix] Remove contiguous output req for context parallel MLA (#25414) · 78237e43
  Michael Goin authored Sep 22, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  78237e43
- [benchmarks]allow skip ready check for bench serve (#25420) · eea17839
  Lucia Fang authored Sep 22, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  eea17839
- [XPU] Fix `compile_size` is `None` case. (#25433) · f225ea7d
  Kunshang Ji authored Sep 23, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f225ea7d
- [feat] Support MRoPE + YaRN (#25384) · fc97733d
  JJJYmmm authored Sep 23, 2025
```
Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>
```
  fc97733d
- [Bug] Fix Long Context OOM Issue (#25290) · 4741239d
  Wentao Ye authored Sep 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4741239d
- [V0 deprecation] Remove `_set_default_args_v0` function (#25409) · c625f904
  Isotr0py authored Sep 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c625f904
- [V0 deprecation] Remove platform v1 controling interface (#25410) · 6fa78d8f
  Isotr0py authored Sep 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6fa78d8f
- [Perf] Apply torch.compile for `per_block_cast_to_fp8` (#24611) · 9949aa2e
  Wentao Ye authored Sep 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9949aa2e
- [Performance] Remove input pads in cutlass_mla and optimize v_proj output handling (#25184) · 0b7bed9c
  Alexander Matveev authored Sep 22, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  0b7bed9c
- [BugFix] [DP/EP] Fix slow execution when BS <= DP (#25407) · ac0048c0
  Matthew Bonanni authored Sep 22, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Chris Bamford <chrisbam4d@gmail.com>
```
  ac0048c0
- [Bugfix] Fix missing `clear_connector_metadata` (#25397) · 09019703
  Nicolò Lucchesi authored Sep 23, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  09019703
- [Core] Drop overly aggressive whisper assertion (#25408) · f31ff874
  Russell Bryant authored Sep 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  f31ff874
- [Bugfix] fix custom op test (#25429) · d588cd24
  Luka Govedič authored Sep 22, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  d588cd24
22 Sep, 2025 4 commits
- [Frontend] Responses API MCP tools for built in tools and to pass through headers (#24628) · 45d7d852
  Alec S authored Sep 22, 2025
```
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec S <10566873+alecsolder@users.noreply.github.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  45d7d852
- [TPU] update torch_xla dependency for PyPI compatibility (#25278) · 8bed1791
  Johnny Yang authored Sep 22, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  8bed1791
- [CI/Build] Skip Qwen3-VL initialization tests until models are actually released (#25394) · f552d5e5
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f552d5e5
- [KV offload][5/N] Add `CPUOffloadingSpec` (#24251) · 8db29392
  Or Ozeri authored Sep 22, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  8db29392