Commits · 3b312fb792d200ba4b1c3b4bf5ad06a46cd2fa1e · OpenDAS / vllm_cscc

30 Dec, 2025 7 commits

[Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
3b312fb7
Add Loraconfig parameter to get_punica_wrapper function (#31408) · f84bf7d7
ZT-AIA authored Dec 30, 2025
```
Signed-off-by: ZT-AIA <1028681969@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
f84bf7d7
Migrate meetups & sponsors [2/N] (#31500) · 99dcf5dc
Roy Wang authored Dec 30, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
99dcf5dc
feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
dc837bc2
[Core] Deduplicate generate/encode logic in `AsyncLLM` (#31510) · e54ee3ea
Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
e54ee3ea

fix: update kimi k2 tool parser logic (#31207) · 358bfd31

wangln19 authored Dec 30, 2025

Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Signed-off-by: Wang Linian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

358bfd31

[Prefix Cache] Include lora_name in BlockStored event for deterministic... · 39512aba

Sage authored Dec 30, 2025


[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Sage <80211083+sagiahrac@users.noreply.github.com>

39512aba

29 Dec, 2025 17 commits
- [CI]Test Group 'NixlConnector PD accuracy tests' is fixed (#31460) · 0f35429a
  qli88 authored Dec 29, 2025
```
Signed-off-by: qli88 <qiang.li2@amd.com>
```
  0f35429a
- [CI/ROCm] Fixing "V1 Test attention (H100)" test group. (#31187) · d63b9696
  Alexei-V-Ivanov-AMD authored Dec 29, 2025
```
Signed-off-by: DCCS-4560 <alivanov@chi-mi325x-pod1-108.ord.vultr.cpe.ice.amd.com>
Signed-off-by: <>
Co-authored-by: DCCS-4560 <alivanov@chi-mi325x-pod1-108.ord.vultr.cpe.ice.amd.com>
Co-authored-by: root <root@chi-mi325x-pod1-108.ord.vultr.cpe.ice.amd.com>
```
  d63b9696
- [Bugfix][ROCm] Fix Static Quant Issue (#31502) · 56f51625
  Robert Shaw authored Dec 29, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  56f51625
- [MoE Refactor][12/N] Marlin Fp8 MoE Pure Function (#31499) · 9152a30d
  Robert Shaw authored Dec 29, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  9152a30d
- [Core] Enable async scheduling by default (#27614) · c2ff33cc
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  c2ff33cc
- implements register kv caches in lmcache connector (#31397) · b12cb383
  chunxiaozheng authored Dec 30, 2025
```
Signed-off-by: idellzheng <idellzheng@tencent.com>
```
  b12cb383
- Optimize QKNorm for MiniMax-M2/M2.1 (#31493) · 5bc66411
  Roger Young authored Dec 30, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  5bc66411
- [Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1
  RickyChen / 陳昭儒 authored Dec 30, 2025
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b3a2bdf1
- Replace `nn.ConvNd` with vLLM's `ConvNdLayer` for Transformers modeling backend (#31498) · e37e7349
  Harry Mellor authored Dec 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e37e7349
- Migrate doc to website: Hardware Plugins (1/N) (#31496) · b5d2d71d
  Roy Wang authored Dec 29, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  b5d2d71d
- [Docs] Use relative `md` links instead of absolute `html` links for cross referencing (#31494) · decc2447
  Harry Mellor authored Dec 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  decc2447
- [Bugfix] Preserve tool call id/type/name in streaming finish chunk (#31438) · 9c884faa
  amittell authored Dec 29, 2025
```
Signed-off-by: amittell <mittell@me.com>
Signed-off-by: Alex Mittell <mittell@me.com>
```
  9c884faa
- [CI] fix test_chat_truncation_content_not_null test (#31488) · 48d5ca4e
  Chauncey authored Dec 29, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  48d5ca4e
- [Bugfix][Frontend] Fix Jina reranker multimodal input compatibility (#31445) · bf73a3e4
  twj authored Dec 29, 2025
```
Signed-off-by: tianwenjing <tianwenjing@jfgenius.com>
Signed-off-by: twj <151701930+twjww@users.noreply.github.com>
Co-authored-by: tianwenjing <tianwenjing@jfgenius.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  bf73a3e4
- [ROCm][GPTQ][Bugfix] Fix GPTQ GEMM kernel output zeroing race condition (#30719) · 3ecfdc37
  Andreas Karatzas authored Dec 29, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3ecfdc37
- [ROCm][CI] Skip DeepGemm-dependent test on ROCm platform (#31462) · 45c1ca1c
  Andreas Karatzas authored Dec 29, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  45c1ca1c
- [CI/Build][CPU] Update CPU CI test cases (#31466) · 17347daa
  Li, Jiang authored Dec 29, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  17347daa
28 Dec, 2025 8 commits
- Add Fused MoE Triton kernels for GLM-4.5-Air, GLM-4.5v, GLM-4.6v on 2x RTX Pro 6000 (#31407) · b9793e6a
  Mamy Ratsimbazafy authored Dec 28, 2025
```
Signed-off-by: Mamy Ratsimbazafy <mamy_github@numforge.co>
```
  b9793e6a
- [Model] Add tuned triton fused_moe configs for Qwen3Moe on B200 (#31448) · 0b6b7010
  Jzz1943 authored Dec 29, 2025
```
Signed-off-by: Zhongze Jiang <jiangzhongze.jzz@ant-intl.com>
```
  0b6b7010
- [BugFix] Re-fix async multimodal cpu tensor race condition (#31373) · 094fcce2
  Nick Hill authored Dec 28, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  094fcce2
- [ROCm] Migrate xgrammar to upstream release (#31327) · 573dd0e6
  Andreas Karatzas authored Dec 28, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  573dd0e6
- [ROCm][CI] Add TorchCodec source build for transcription tests (#31323) · f7036886
  Andreas Karatzas authored Dec 28, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f7036886
- [ROCm][CI] Added perceptron lib in requirements for isaac multi-modal test (#31441) · 96142f20
  Andreas Karatzas authored Dec 27, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  96142f20
- [BugFix] register quant scale tensors as buffer (#31395) · 62def07d
  Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  62def07d
- add tip for VLLM_USE_PRECOMPILED arg to reduce docker build time (#31385) · b326598e
  yitingdc authored Dec 28, 2025
```
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
```
  b326598e
27 Dec, 2025 6 commits
- [MoE Refactor][10/N] Cleanup Fp8 Process Weights After Loading (#31169) · 727c41f3
  Robert Shaw authored Dec 27, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  727c41f3
- [BugFix] Fix cache issue in compilation_config (#31376) · 2f12cd32
  Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  2f12cd32
- [Chore]: Remove HF format Phi4-MM examples (#31405) · 40a87562
  Isotr0py authored Dec 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40a87562
- [CI/Build] Ignore max transformers version for more common tests (#31401) · 3d024985
  Isotr0py authored Dec 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3d024985
- Fix/get raw stream patch #30905 (#30912) · 8711b216
  baonudesifeizhai authored Dec 26, 2025
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  8711b216
- [Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166) · 52bf0665
  Yifan Qiao authored Dec 26, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: KuntaiDu <kuntai@uchicago.edu>
```
  52bf0665
26 Dec, 2025 2 commits
- [XPU][CI]skip test_preprocess_error_handling due to fork/spawn issue (#31381) · 5326c898
  Kunshang Ji authored Dec 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  5326c898
- CustomOp: Unify aiter impl into GroupedTopk (#31221) · 87f1b8ca
  Xinyu Chen authored Dec 27, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  87f1b8ca