Commits · 20d7454c9bb0c2de7f59863f5030e5f494cab178 · OpenDAS / vllm_cscc · GitLab

"examples/offline_inference/llm_engine_reset_kv.py" did not exist on "c3442c1f6fabe54adb82d2d676920c5f31b9834e"

06 Feb, 2026 3 commits
- fix(ROCm): Make flash_attn import optional in MLA attention (#33511) · 20d7454c
  Rabi Mishra authored Feb 06, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  20d7454c
- [Perf] Disable clean_logits in deepgemm fp8_mqa_logits kernel (#33568) · 79028d43
  Xin Yang authored Feb 05, 2026
  
  79028d43
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0
05 Feb, 2026 35 commits
- [Bugfix] Fix DeepSeek v3.2 tokenizer outputting None issue (#33832) · 91a07ff6
  Wei Zhao authored Feb 05, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  91a07ff6
- Adds padding and perf improvements to wvSplitK_fp8 (#33527) · d5c48001
  Hashem Hashemi authored Feb 05, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  d5c48001
- [Minor] Sort safetensors files to ensure deterministic loading order (#33491) · 42d5d705
  Lumosis authored Feb 05, 2026
```
Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  42d5d705
- [Bugfix] Make MM batching more robust (#33817) · 116880a5
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  116880a5
- [Bugfix] Fix DSV3.2 NVFP4 (#33932) · 4145e50d
  Matthew Bonanni authored Feb 05, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4145e50d
- [Misc] Rename `translations` to `speech_to_text` for OAI serving component (#33904) · 20f5d185
  Nicolò Lucchesi authored Feb 05, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  20f5d185
- [Bugfix] Suppress non-TTY color output on the process name part of the log (#29714) · 92e7562a
  Tsukasa OI authored Feb 06, 2026
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  92e7562a
- [Models] Consolidate Deepseek-OCR2 processor (#33909) · 87d0d17a
  Isotr0py authored Feb 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  87d0d17a
- [Moe Refactor] Make Inplace Flag for FusedMoEModularKernel part of the constructor (#33375) · a57c8228
  bnellnm authored Feb 05, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a57c8228
- [Bugfix] Fix swapped engine_ids in NIXL Llama 4 local attention path (#33795) · 1ee95841
  zackyoray authored Feb 05, 2026
```
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
```
  1ee95841
- [Misc] Add debug logs (#33931) · 7d8c6804
  Nicolò Lucchesi authored Feb 05, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  7d8c6804
- [Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
  Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  af3162d3
- [BugFix] Fix LoRA Fp8 (#33879) · 5b2a9422
  danisereb authored Feb 05, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  5b2a9422
- [Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e
  Aaron Hao authored Feb 05, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>
```
  c1858b7e
- [Bugfix] Fix step3p5 parser when using mtp (#33690) · 82914d2a
  Mario Hong authored Feb 06, 2026
```
Signed-off-by: mariohong <mariohong128@gmail.com>
```
  82914d2a
- [Bugfix] Fix corner case of sparse embedding (#33886) · 1c3a221d
  wang.yuqi authored Feb 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1c3a221d
- [Refactor] Clean up input preprocessing (#33687) · 7bd42e60
  Cyrus Leung authored Feb 05, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7bd42e60
- [Bugfix] Fix Kimi-K2.5 NVFP4 checkpoints weight loading (#33876) · a2522839
  Isotr0py authored Feb 05, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a2522839
- [perf] Integrate flashinfer concat_mla_k (#31171) · 59a5cb38
  jiahanc authored Feb 05, 2026
  
  59a5cb38
- Enable Cross layers KV cache layout at NIXL Connector V2 (#33339) · 8322d4e4
  liranschour authored Feb 05, 2026
```
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  8322d4e4
- [ROCm][Bugfix][CI] Fix hybrid models and their tests (Mamba/Jamba/Bamba) (#32710) · 3e472e81
  Andreas Karatzas authored Feb 05, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  3e472e81
- [Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7
  Cyrus Leung authored Feb 05, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  038914b7
- [Bugfix] Kimi-K2 grouped_topk usage for Flashinfer monolithic kernels. (#33858) · d2f4a71c
  Pavani Majety authored Feb 05, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  d2f4a71c
- [KV Connector][Metrics] Do not count local prefix cache hits in connector queries (#30522) · 2abd9759
  Mark McLoughlin authored Feb 05, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  2abd9759
- [Perf] Optimize the performance of structured output + reasoning (#33557) · 6abb0454
  Chauncey authored Feb 05, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  6abb0454
- [CPU][BugFix] Allow w8a8 oneDNN quantized matmul to support 3D inputs (#33727) · fd03538b
  Fadi Arafeh authored Feb 05, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  fd03538b
- [CI/Build] Parallelize CPU CI tests (#33778) · 07daee13
  Li, Jiang authored Feb 05, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  07daee13
- [2/N] move responses/serving _make_response_output_items logic to parser (#33281) · 9595afda
  Andrew Xia authored Feb 05, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  9595afda
- [Minor] Include `StreamingInput` in inputs package (#33856) · add9f1fb
  Nick Hill authored Feb 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  add9f1fb
- Revert "[Attention][FA3] Update FA3 to include new swizzle optimization" (#33841) · e3bf79ff
  Luka Govedič authored Feb 04, 2026
  
  e3bf79ff
- [CI][Bugfix]: return McpCall for built-in MCP tools in non-streaming mode (#32762) · fb1270f1
  Andreas Karatzas authored Feb 04, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  fb1270f1
- [Bugfix] fix DeepSeek R1 with CUTLASS MLA Broken on B200 (#33637) · a7be77be
  Chauncey authored Feb 05, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a7be77be
- [Bugfix] Disable TRTLLM attention when KV transfer is enabled (#33192) · bbe0574d
  zhanqiuhu authored Feb 04, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
```
  bbe0574d
- [CI][torch.compile] Reduce e2e fusion test time (#33293) · 4d951353
  Luka Govedič authored Feb 04, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  4d951353
- feat: Add ColBERT late interaction model support (#33686) · 439afa4e
  Ilya Boytsov authored Feb 05, 2026
```
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  439afa4e
04 Feb, 2026 2 commits

[Core] Don't schedule spec tokens with prefill chunks (#33652) · fa4e0fb0
Nick Hill authored Feb 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
fa4e0fb0

Change the type signature of MixtureOfExperts.expert_weights to... · ce498a6d

Sage Moore authored Feb 04, 2026

Change the type signature of MixtureOfExperts.expert_weights to MutableSequence[Sequence[Tensor]] (#33573)
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

ce498a6d