Commits · b12cb38398a57a4abc4b8fb120fd39e97029ffa1 · OpenDAS / vllm_cscc · GitLab

29 Dec, 2025 12 commits
- implements register kv caches in lmcache connector (#31397) · b12cb383
  chunxiaozheng authored Dec 30, 2025
```
Signed-off-by: idellzheng <idellzheng@tencent.com>
```
  b12cb383
- Optimize QKNorm for MiniMax-M2/M2.1 (#31493) · 5bc66411
  Roger Young authored Dec 30, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  5bc66411
- [Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1
  RickyChen / 陳昭儒 authored Dec 30, 2025
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b3a2bdf1
- Replace `nn.ConvNd` with vLLM's `ConvNdLayer` for Transformers modeling backend (#31498) · e37e7349
  Harry Mellor authored Dec 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e37e7349
- Migrate doc to website: Hardware Plugins (1/N) (#31496) · b5d2d71d
  Roy Wang authored Dec 29, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  b5d2d71d
- [Docs] Use relative `md` links instead of absolute `html` links for cross referencing (#31494) · decc2447
  Harry Mellor authored Dec 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  decc2447
- [Bugfix] Preserve tool call id/type/name in streaming finish chunk (#31438) · 9c884faa
  amittell authored Dec 29, 2025
```
Signed-off-by: amittell <mittell@me.com>
Signed-off-by: Alex Mittell <mittell@me.com>
```
  9c884faa
- [CI] fix test_chat_truncation_content_not_null test (#31488) · 48d5ca4e
  Chauncey authored Dec 29, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  48d5ca4e
- [Bugfix][Frontend] Fix Jina reranker multimodal input compatibility (#31445) · bf73a3e4
  twj authored Dec 29, 2025
```
Signed-off-by: tianwenjing <tianwenjing@jfgenius.com>
Signed-off-by: twj <151701930+twjww@users.noreply.github.com>
Co-authored-by: tianwenjing <tianwenjing@jfgenius.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  bf73a3e4
- [ROCm][GPTQ][Bugfix] Fix GPTQ GEMM kernel output zeroing race condition (#30719) · 3ecfdc37
  Andreas Karatzas authored Dec 29, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3ecfdc37
- [ROCm][CI] Skip DeepGemm-dependent test on ROCm platform (#31462) · 45c1ca1c
  Andreas Karatzas authored Dec 29, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  45c1ca1c
- [CI/Build][CPU] Update CPU CI test cases (#31466) · 17347daa
  Li, Jiang authored Dec 29, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  17347daa
28 Dec, 2025 8 commits
- Add Fused MoE Triton kernels for GLM-4.5-Air, GLM-4.5v, GLM-4.6v on 2x RTX Pro 6000 (#31407) · b9793e6a
  Mamy Ratsimbazafy authored Dec 28, 2025
```
Signed-off-by: Mamy Ratsimbazafy <mamy_github@numforge.co>
```
  b9793e6a
- [Model] Add tuned triton fused_moe configs for Qwen3Moe on B200 (#31448) · 0b6b7010
  Jzz1943 authored Dec 29, 2025
```
Signed-off-by: Zhongze Jiang <jiangzhongze.jzz@ant-intl.com>
```
  0b6b7010
- [BugFix] Re-fix async multimodal cpu tensor race condition (#31373) · 094fcce2
  Nick Hill authored Dec 28, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  094fcce2
- [ROCm] Migrate xgrammar to upstream release (#31327) · 573dd0e6
  Andreas Karatzas authored Dec 28, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  573dd0e6
- [ROCm][CI] Add TorchCodec source build for transcription tests (#31323) · f7036886
  Andreas Karatzas authored Dec 28, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f7036886
- [ROCm][CI] Added perceptron lib in requirements for isaac multi-modal test (#31441) · 96142f20
  Andreas Karatzas authored Dec 27, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  96142f20
- [BugFix] register quant scale tensors as buffer (#31395) · 62def07d
  Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  62def07d
- add tip for VLLM_USE_PRECOMPILED arg to reduce docker build time (#31385) · b326598e
  yitingdc authored Dec 28, 2025
```
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
```
  b326598e
27 Dec, 2025 6 commits
- [MoE Refactor][10/N] Cleanup Fp8 Process Weights After Loading (#31169) · 727c41f3
  Robert Shaw authored Dec 27, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  727c41f3
- [BugFix] Fix cache issue in compilation_config (#31376) · 2f12cd32
  Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  2f12cd32
- [Chore]: Remove HF format Phi4-MM examples (#31405) · 40a87562
  Isotr0py authored Dec 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40a87562
- [CI/Build] Ignore max transformers version for more common tests (#31401) · 3d024985
  Isotr0py authored Dec 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3d024985
- Fix/get raw stream patch #30905 (#30912) · 8711b216
  baonudesifeizhai authored Dec 26, 2025
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  8711b216
- [Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166) · 52bf0665
  Yifan Qiao authored Dec 26, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: KuntaiDu <kuntai@uchicago.edu>
```
  52bf0665
26 Dec, 2025 12 commits
- [XPU][CI]skip test_preprocess_error_handling due to fork/spawn issue (#31381) · 5326c898
  Kunshang Ji authored Dec 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  5326c898
- CustomOp: Unify aiter impl into GroupedTopk (#31221) · 87f1b8ca
  Xinyu Chen authored Dec 27, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  87f1b8ca
- [Docs] Add profiler user docs for http request (#31370) · 887e900b
  rongfu.leng authored Dec 26, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  887e900b
- [Mistral common] Ensure all functions are imported from the top & only use public methods (#31138) · 48e74497
  Patrick von Platen authored Dec 26, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  48e74497
- [Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1
  Jee Jee Li authored Dec 26, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
```
  ce1eafd1
- [Docs] Fix some snippets (#31378) · 0b544e64
  Harry Mellor authored Dec 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0b544e64
- [Misc] Fix Qwen2-MoE shared_expert_gate (#31339) · c3666f56
  Jee Jee Li authored Dec 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c3666f56
- [CI] Fix flaky vision beam search test with flexible semantic validation (#31324) · c79dbfa9
  Andreas Karatzas authored Dec 25, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c79dbfa9
- Support LoRA and GPTQModel for PLaMo 2/3 (#31322) · 9ee05cbe
  Shinichi Hemmi authored Dec 26, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
  9ee05cbe
- [benchmark] use model card root instead of id (#31329) · 3b8f31b3
  Ning Xie authored Dec 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3b8f31b3
- [CI/Build] Ignore max transformers version skipping for initialization tests (#30619) · 2cd94259
  Isotr0py authored Dec 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2cd94259
- Feature/isaac 0.1 (#28367) · b7165d53
  oscardev256 authored Dec 25, 2025
```
Signed-off-by: oscardev256 <42308241+oscardev256@users.noreply.github.com>
Signed-off-by: Oscar Gonzalez <ogonzal6@alumni.jh.edu>
Signed-off-by: Yang <lymailforjob@gmail.com>
Co-authored-by: Yang <lymailforjob@gmail.com>
```
  b7165d53
25 Dec, 2025 2 commits
- [BugFix] Fix async scheduling + reasoning with struct output (#31332) · 81786c87
  Nick Hill authored Dec 25, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  81786c87
- [Hybrid] Mamba2 prefix cache blocks freeing for running requests (#28047) · f1531d9f
  Stan Wozniak authored Dec 25, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  f1531d9f