Commits · 44b5ce956d3cf28841615a58c1c0873af87bcfe2 · OpenDAS / vllm_cscc

28 Oct, 2025 9 commits
- [Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431) · 44b5ce95
  Matthew Bonanni authored Oct 28, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  44b5ce95
- [V0 Deprecation] Remove vestigial V0 logits_processors.py file (#27601) · 7a865f23
  Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7a865f23
- Fix a robust parsing issue in KimiK2ToolParser that causes IndexError (#27565) · 2fa90bda
  wangln19 authored Oct 28, 2025
```
Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
```
  2fa90bda
- [Core][Bookkeeping Optimization] Update against numpy view of is_token_ids tensor (#27618) · b46e4a06
  Jialin Ouyang authored Oct 28, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b46e4a06
- [Bugfix][CPU] Fallback oneDNN linear to torch linear to fix half gemm support... · d34f5fe9
  Li, Jiang authored Oct 28, 2025
```
[Bugfix][CPU] Fallback oneDNN linear to torch linear to fix half gemm support on legecy platforms (#27526)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d34f5fe9
- [Hardware][AMD][Model] Triton MoE tuning configs for GLM-4.6 for MI300X (#27323) · bdb01a38
  Eric Yue authored Oct 28, 2025
```
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
```
  bdb01a38
- [Bugfix] fixed inconsistent finish_reason handling between V0 and V1 engines (#27555) · 61fbfe52
  Chauncey authored Oct 28, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  61fbfe52
- [Stability fix] turn off HMA allocator when connector is set (#27592) · 255e34ca
  Kuntai Du authored Oct 27, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  255e34ca
- [Bugfix][CI] Fix config resolving logic with remote models (#27610) · a8d2e326
  Roger Wang authored Oct 27, 2025
  
  a8d2e326
27 Oct, 2025 19 commits
- [gpt-oss][2/N] Support input_messages in responsesRequest (#26962) · 53a56e65
  Andrew Xia authored Oct 27, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  53a56e65
- Code quality improvements: version update, type annotation enhancement, and... · 69f06406
  usberkeley authored Oct 28, 2025
```
Code quality improvements: version update, type annotation enhancement, and enum usage simplification (#27581)
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  69f06406
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
- fixing mm placeholder replacement issue with gemma3 (#27538) · 23ad8205
  tingtinggithub authored Oct 27, 2025
```
Signed-off-by: tingtingtang1992 <streamttt@gmail.com>
```
  23ad8205
- [Bugfix][LoRA][FusedMoE] Select MxFP4 Backend based on LoRA Enablement (#27487) · 5d3be3ba
  Varun Sundar Rabindranath authored Oct 27, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  5d3be3ba
- [Model] Siglip2 Model Support (#27566) · 4f882be4
  Yu Jiaqi authored Oct 27, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
  4f882be4
- [Hybrid] Added supports_mamba_prefix_caching Protocol (#27339) · 92737542
  Asaf Joseph Gardin authored Oct 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  92737542
- [Kernel] Enable moe LoRA kernel support FP16 (#27468) · f4e81540
  Jee Jee Li authored Oct 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f4e81540
- [cpu][perf] Fix low CPU utilization with VLLM_CPU_OMP_THREADS_BIND on AArch64 (#27415) · a663f6ae
  Fadi Arafeh authored Oct 27, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  a663f6ae
- [Bugfix] Fixed when return_token_ids=False, the first event still contains... · a4fc2189
  Chauncey authored Oct 27, 2025
```
[Bugfix] Fixed when return_token_ids=False, the first event still contains prompt_token_ids. (#27561)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a4fc2189
- [Bugfix] Limit the default value of `max_model_len` when it is not specified by users (#27556) · a3e8611d
  Shanshan Shen authored Oct 27, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  a3e8611d
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83
- [Kernel] Adding split_K implementation for fused_moe_lora (#27291) · 9932ed6a
  Danielle Robinson authored Oct 27, 2025
```
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9932ed6a
- [Doc] Slight improvement to M2 and beyond (#27554) · 2d631d28
  Jee Jee Li authored Oct 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  2d631d28
- [Model] Deprecate `merge_by_field_config=False` (#27551) · b3683829
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b3683829
- [Performance][LoRA] add context varying params to 'do_not_specialize' in fused moe lora (#27445) · a806c14c
  gnovack authored Oct 26, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  a806c14c
- [Model] Use merge_by_field_config for MM models (Qwen series) (#27546) · cbd5e07a
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd5e07a
- [Model][Bugfix] fix ernie45 moe 300B SharedFusedMoE output tuple (#27316) · 63b22e0d
  CSWYF3634076 authored Oct 27, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  63b22e0d
- Fix MiniMax-M2 copyright (#27537) · 5980604c
  Roger Young authored Oct 27, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  5980604c
26 Oct, 2025 5 commits
- [Model][MiniMax-M2] Support MiniMax-M2 Model (#27535) · 720af6ab
  Roger Young authored Oct 27, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  720af6ab
- [Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6
  Yeshwanth N authored Oct 26, 2025
```
Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>
```
  71b1c8b6
- [bugfix]fix empty prompts for async-engine mode in benchmark throughput (#27494) · 315b860a
  Lucia Fang authored Oct 26, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  315b860a
- [Bugfix] Fix processor initialization for model from modelscope instead of HF (#27461) · 87c41c26
  rongfu.leng authored Oct 26, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  87c41c26
- [BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl... · 65d2cf95
  JartX authored Oct 26, 2025
```
[BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl ROCm TORCH_SDPA (#27190)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  65d2cf95
25 Oct, 2025 6 commits
- [CI/Build] Refactor processing tests (#27470) · 66a168a1
  Cyrus Leung authored Oct 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  66a168a1
- [Attention] Add missing kv cache scale setup (#27490) · a99564ac
  Matthew Bonanni authored Oct 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a99564ac
- [Misc] Simplify max tokens in multimodal registry (#27500) · 4c5f6321
  Cyrus Leung authored Oct 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4c5f6321
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
- Revert "[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selectio… (#27502) · 56ed7609
  Zhuohan Li authored Oct 24, 2025
  
  56ed7609
- [KVConnector] Migrate the LMCache integration code to be vLLM native (#25542) · 83f478bb
  Yihua Cheng authored Oct 24, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  83f478bb
24 Oct, 2025 1 commit

[Misc][DP] Guard mxfp4 implementation selection (#27484) · 269c4db0

Varun Sundar Rabindranath authored Oct 24, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

269c4db0