Commits · 20f5d185a6f570b74ab403577cd4eabe44d14496 · OpenDAS / vllm_cscc · GitLab

05 Feb, 2026 30 commits
- [Misc] Rename `translations` to `speech_to_text` for OAI serving component (#33904) · 20f5d185
  Nicolò Lucchesi authored Feb 05, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  20f5d185
- [Bugfix] Suppress non-TTY color output on the process name part of the log (#29714) · 92e7562a
  Tsukasa OI authored Feb 06, 2026
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  92e7562a
- [Models] Consolidate Deepseek-OCR2 processor (#33909) · 87d0d17a
  Isotr0py authored Feb 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  87d0d17a
- [Moe Refactor] Make Inplace Flag for FusedMoEModularKernel part of the constructor (#33375) · a57c8228
  bnellnm authored Feb 05, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a57c8228
- [Bugfix] Fix swapped engine_ids in NIXL Llama 4 local attention path (#33795) · 1ee95841
  zackyoray authored Feb 05, 2026
```
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
```
  1ee95841
- [Misc] Add debug logs (#33931) · 7d8c6804
  Nicolò Lucchesi authored Feb 05, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  7d8c6804
- [Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
  Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  af3162d3
- [BugFix] Fix LoRA Fp8 (#33879) · 5b2a9422
  danisereb authored Feb 05, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  5b2a9422
- [Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e
  Aaron Hao authored Feb 05, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>
```
  c1858b7e
- [Bugfix] Fix step3p5 parser when using mtp (#33690) · 82914d2a
  Mario Hong authored Feb 06, 2026
```
Signed-off-by: mariohong <mariohong128@gmail.com>
```
  82914d2a
- [Bugfix] Fix corner case of sparse embedding (#33886) · 1c3a221d
  wang.yuqi authored Feb 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1c3a221d
- [Refactor] Clean up input preprocessing (#33687) · 7bd42e60
  Cyrus Leung authored Feb 05, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7bd42e60
- [Bugfix] Fix Kimi-K2.5 NVFP4 checkpoints weight loading (#33876) · a2522839
  Isotr0py authored Feb 05, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a2522839
- [perf] Integrate flashinfer concat_mla_k (#31171) · 59a5cb38
  jiahanc authored Feb 05, 2026
  
  59a5cb38
- Enable Cross layers KV cache layout at NIXL Connector V2 (#33339) · 8322d4e4
  liranschour authored Feb 05, 2026
```
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  8322d4e4
- [ROCm][Bugfix][CI] Fix hybrid models and their tests (Mamba/Jamba/Bamba) (#32710) · 3e472e81
  Andreas Karatzas authored Feb 05, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  3e472e81
- [Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7
  Cyrus Leung authored Feb 05, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  038914b7
- [Bugfix] Kimi-K2 grouped_topk usage for Flashinfer monolithic kernels. (#33858) · d2f4a71c
  Pavani Majety authored Feb 05, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  d2f4a71c
- [KV Connector][Metrics] Do not count local prefix cache hits in connector queries (#30522) · 2abd9759
  Mark McLoughlin authored Feb 05, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  2abd9759
- [Perf] Optimize the performance of structured output + reasoning (#33557) · 6abb0454
  Chauncey authored Feb 05, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  6abb0454
- [CPU][BugFix] Allow w8a8 oneDNN quantized matmul to support 3D inputs (#33727) · fd03538b
  Fadi Arafeh authored Feb 05, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  fd03538b
- [CI/Build] Parallelize CPU CI tests (#33778) · 07daee13
  Li, Jiang authored Feb 05, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  07daee13
- [2/N] move responses/serving _make_response_output_items logic to parser (#33281) · 9595afda
  Andrew Xia authored Feb 05, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  9595afda
- [Minor] Include `StreamingInput` in inputs package (#33856) · add9f1fb
  Nick Hill authored Feb 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  add9f1fb
- Revert "[Attention][FA3] Update FA3 to include new swizzle optimization" (#33841) · e3bf79ff
  Luka Govedič authored Feb 04, 2026
  
  e3bf79ff
- [CI][Bugfix]: return McpCall for built-in MCP tools in non-streaming mode (#32762) · fb1270f1
  Andreas Karatzas authored Feb 04, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  fb1270f1
- [Bugfix] fix DeepSeek R1 with CUTLASS MLA Broken on B200 (#33637) · a7be77be
  Chauncey authored Feb 05, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a7be77be
- [Bugfix] Disable TRTLLM attention when KV transfer is enabled (#33192) · bbe0574d
  zhanqiuhu authored Feb 04, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
```
  bbe0574d
- [CI][torch.compile] Reduce e2e fusion test time (#33293) · 4d951353
  Luka Govedič authored Feb 04, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  4d951353
- feat: Add ColBERT late interaction model support (#33686) · 439afa4e
  Ilya Boytsov authored Feb 05, 2026
```
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  439afa4e
04 Feb, 2026 10 commits
- [Core] Don't schedule spec tokens with prefill chunks (#33652) · fa4e0fb0
  Nick Hill authored Feb 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  fa4e0fb0
- Change the type signature of MixtureOfExperts.expert_weights to... · ce498a6d
  Sage Moore authored Feb 04, 2026
```
Change the type signature of MixtureOfExperts.expert_weights to MutableSequence[Sequence[Tensor]] (#33573)
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  ce498a6d
- Revert "[torch.compile] Significantly speed up cold start times" (#33820) · 9f14c922
  Richard Zou authored Feb 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  9f14c922
- [Model] Add transcription support for Qwen3-Omni (#29828) · 535de06c
  Muhammad Hashmi authored Feb 04, 2026
```
Signed-off-by: Muhammad Hashmi <mhashmi@berkeley.edu>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
  535de06c
- [Bugfix] Support `RotaryEmbedding` CustomOp for gpt-oss (#33800) · 4292c90a
  Simon Danielsson authored Feb 04, 2026
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
  4292c90a
- Implement zero-copy GQA for multimodal and CPU (#33732) · 6e98f6d8
  Taeksang Kim authored Feb 05, 2026
```
Signed-off-by: Taeksang Kim <ts.kim@hyperaccel.ai>
```
  6e98f6d8
- [rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308) · 2f6d17cb
  kourosh hakhamaneshi authored Feb 04, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  2f6d17cb
- [Bugfix] Fix interns1-pro initialization and PP (#33793) · 192ad464
  Isotr0py authored Feb 05, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  192ad464
- [Misc] Delay deprecation of CommonAttentionMetadata properties (#33801) · 0e922986
  Lucas Wilkinson authored Feb 04, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  0e922986
- [Bugfix] Fix ubatch wrapper num_tokens calculate (#33694) · 87d9a261
  jiangkuaixue123 authored Feb 05, 2026
```
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
```
  87d9a261