Commits · 1f5b7c41c3e3ed97152d0ae28091141280fff20f · OpenDAS / vllm_cscc

02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

31 Dec, 2025 14 commits

[Audio] Improve Audio Inference Scripts (offline/online) (#29279) · adcf682f
Ekagra Ranjan authored Dec 31, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
adcf682f
[CI][Bugfix] Fix token counting in chunked prefill streaming test (#31565) · 21de6d4b
Andreas Karatzas authored Dec 31, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
21de6d4b
[BugFix] Fix async scheduling for pooling models (#31584) · 6c2cfb62
Nick Hill authored Dec 31, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
6c2cfb62

[Bugfix] Fix BAGEL online serving for text and image understanding (#31546) · d8da76f3

Fanjiang Ye authored Dec 31, 2025


Signed-off-by: Dylan1229 <yvanphys@gmail.com>
Signed-off-by: UED <zxr3611244710@gmail.com>
Signed-off-by: mr-ye-cao <yecaoyc2019@gmail.com>
Co-authored-by: UED <zxr3611244710@gmail.com>
Co-authored-by: mr-ye-cao <yecaoyc2019@gmail.com>
Co-authored-by: Mr-Ye-Cao <60802056+Mr-Ye-Cao@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

d8da76f3

Add GLM-ASR multimodal support (#31436) · d722e9e6

baonudesifeizhai authored Dec 31, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

d722e9e6

[ROCm][CI] Update MiniCPM model test: MiniCPM3-4B to MiniCPM4.1-8B and... · cf16342d

Andreas Karatzas authored Dec 31, 2025


[ROCm][CI] Update MiniCPM model test: MiniCPM3-4B to MiniCPM4.1-8B and simplify attention backend testing (#31551)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

cf16342d

[Bug] Fix log issue with `\n` (#31390) · 357d435c

Wentao Ye authored Dec 31, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

357d435c

Add get_expert_mapping to NemotronHModel (for LoRA support) (#31539) · 108a2728
danisereb authored Dec 31, 2025
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
108a2728
[CI] [Critical] [CUDA] Fix duplicated test name (#31562) · 578c8f51
TJian authored Dec 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
578c8f51
[Core] Remove unused `num_tokens` parameter from `_init_model_kwargs` (#31517) · b4bb5f31
maang-h authored Dec 31, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
b4bb5f31

[BugFix] Fix NUMA node validation in CPU platform (#31520) · 70e1acef

SameerAsal authored Dec 30, 2025


Signed-off-by: SameerAsal <SameerAsal@users.noreply.github.com>
Co-authored-by: SameerAsal <SameerAsal@users.noreply.github.com>

70e1acef

[Mics] add pcp basic support to MoE model (#31003) · 84f6cd74
Qiu authored Dec 31, 2025

84f6cd74
[Fix] Align fused moe lora_b shape with peft (#31534) · ecd49ce7
B-201 authored Dec 31, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
ecd49ce7
Add docker buildx bake configuration (#31477) · e1ee11b2
Amr Mahdi authored Dec 30, 2025
```
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
```
e1ee11b2

30 Dec, 2025 15 commits
- [Bugfix]Fix pooling model always disabled due to incorrect PP rank check (#31505) · 04147dcf
  vintipandey authored Dec 30, 2025
```
Signed-off-by: vintipandey <vinti.pandey@gmail.com>
```
  04147dcf
- [BugFix] add select_gemm_impl on CompressedTensorsWNA16MoEMethod to support LoRA (#31453) · 07728bf5
  JartX authored Dec 30, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  07728bf5
- [Model] Add support for openPangu moe model (#28775) · 3f52fa5a
  yt0428 authored Dec 31, 2025
```
Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  3f52fa5a
- [CPU] Disable async schedule on CPU (#31525) · 71575961
  Li, Jiang authored Dec 30, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  71575961
- [CI][NIXL] Split DPEP tests (#31491) · ab1af6aa
  Nicolò Lucchesi authored Dec 30, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ab1af6aa
- [ROCm][Bugfix] Fix accuracy issue on fmoe when... · 1a834df2
  Pleaplusone authored Dec 30, 2025
```
[ROCm][Bugfix] Fix accuracy issue on fmoe when `VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS` enabled (#31523)
Signed-off-by: ganyi <ygan@amd.com>
```
  1a834df2
- [Frontend] add continue_final_message parameter to /embeddings endpoint (#31497) · 51085c2a
  Kevin authored Dec 29, 2025
```
Signed-off-by: Kevin P-W <140451262+kevin-pw@users.noreply.github.com>
```
  51085c2a
- [xpu] [bugfix] upgrade to latest oneccl in dockerfile (#31522) · 3d973764
  Roger Feng authored Dec 30, 2025
```
Signed-off-by: roger feng <roger.feng@intel.com>
```
  3d973764
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
- Add Loraconfig parameter to get_punica_wrapper function (#31408) · f84bf7d7
  ZT-AIA authored Dec 30, 2025
```
Signed-off-by: ZT-AIA <1028681969@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f84bf7d7
- Migrate meetups & sponsors [2/N] (#31500) · 99dcf5dc
  Roy Wang authored Dec 30, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  99dcf5dc
- feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
  Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
  dc837bc2
- [Core] Deduplicate generate/encode logic in `AsyncLLM` (#31510) · e54ee3ea
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  e54ee3ea
- fix: update kimi k2 tool parser logic (#31207) · 358bfd31
  wangln19 authored Dec 30, 2025
```
Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Signed-off-by: Wang Linian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  358bfd31
- [Prefix Cache] Include lora_name in BlockStored event for deterministic... · 39512aba
  Sage authored Dec 30, 2025
```
[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Sage <80211083+sagiahrac@users.noreply.github.com>
```
  39512aba
29 Dec, 2025 10 commits

[CI]Test Group 'NixlConnector PD accuracy tests' is fixed (#31460) · 0f35429a
qli88 authored Dec 29, 2025
```
Signed-off-by: qli88 <qiang.li2@amd.com>
```
0f35429a

[CI/ROCm] Fixing "V1 Test attention (H100)" test group. (#31187) · d63b9696

Alexei-V-Ivanov-AMD authored Dec 29, 2025

Signed-off-by: DCCS-4560 <alivanov@chi-mi325x-pod1-108.ord.vultr.cpe.ice.amd.com>
Signed-off-by: <>
Co-authored-by: DCCS-4560 <alivanov@chi-mi325x-pod1-108.ord.vultr.cpe.ice.amd.com>
Co-authored-by: root <root@chi-mi325x-pod1-108.ord.vultr.cpe.ice.amd.com>

d63b9696

[Bugfix][ROCm] Fix Static Quant Issue (#31502) · 56f51625

Robert Shaw authored Dec 29, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

56f51625

[MoE Refactor][12/N] Marlin Fp8 MoE Pure Function (#31499) · 9152a30d
Robert Shaw authored Dec 29, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
9152a30d
[Core] Enable async scheduling by default (#27614) · c2ff33cc
Nick Hill authored Dec 29, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
c2ff33cc
implements register kv caches in lmcache connector (#31397) · b12cb383
chunxiaozheng authored Dec 30, 2025
```
Signed-off-by: idellzheng <idellzheng@tencent.com>
```
b12cb383
Optimize QKNorm for MiniMax-M2/M2.1 (#31493) · 5bc66411
Roger Young authored Dec 30, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
5bc66411

[Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1

RickyChen / 陳昭儒 authored Dec 30, 2025

Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b3a2bdf1

Replace `nn.ConvNd` with vLLM's `ConvNdLayer` for Transformers modeling backend (#31498) · e37e7349
Harry Mellor authored Dec 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
e37e7349
Migrate doc to website: Hardware Plugins (1/N) (#31496) · b5d2d71d
Roy Wang authored Dec 29, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
b5d2d71d