Commits · 9c7cab5ebb0f8a15e632e7ea2cfeebcca1d3628f · OpenDAS / vllm_cscc · GitLab

17 Mar, 2026 14 commits
- [Feature]: Support for multiple embedding types in a single inference call (#35829) · 9c7cab5e
  Augusto Yao authored Mar 17, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  9c7cab5e
- [Bugfix][ResponsesAPI] Fix crash when tool_choice=required exceeds max_output_tokens (#37258) · 132bfd45
  Chauncey authored Mar 17, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  132bfd45
- Fix infinite recursive search issue in quark.py (#32779) · 24b4272a
  xiao-llm authored Mar 17, 2026
```
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
Signed-off-by: Xiao Yu <xiao.yu.dc@outlook.com>
Signed-off-by: kimheesu <wlskaka4@gmail.com>
Co-authored-by: Yanwen Lin <lyw1124278064@gmail.com>
Co-authored-by: Kim Hee Su <wlskaka4@gmail.com>
```
  24b4272a
- [Bugfix] Fix NemotronH MTP + Chunked Prefill (#35447) · 8a680463
  Benjamin Chislett authored Mar 17, 2026
  
  8a680463
- [Bugfix] Fix loading Music Flamingo (#35535) · 20b14095
  Nick Cao authored Mar 17, 2026
```
Signed-off-by: Nick Cao <ncao@redhat.com>
```
  20b14095
- [Bugfix] dtype mismatch in ngram gpu propose (#37246) · 17c1bdf3
  PatchyTIS authored Mar 17, 2026
```
Signed-off-by: PatchouliTaisa <patchychen@tencent.com>
Co-authored-by: PatchouliTaisa <patchychen@tencent.com>
```
  17c1bdf3
- [Refactor] Relocate responses API tests (#37241) · 3e3d320c
  Flora Feng authored Mar 17, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  3e3d320c
- [ROCm] Fix AttributeError for torch.compiler.skip_all_guards_unsafe on older PyTorch (#37219) · 54a62a79
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  54a62a79
- [Refactor] Relocate completion and chat completion tests (#37125) · 384dc7f7
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  384dc7f7
- [CI] Fix flaky tool_use chat completion tests with deterministic seed (#37027) · f04d5226
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  f04d5226
- Add ability to replace oot ops when using lora (#37181) · 0a0a1a19
  Kyuyeun Kim authored Mar 16, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  0a0a1a19
- Support non-contiguous KV cache in TRTLLM fp8 dequant kernel (#36867) · 6c1cfbad
  Vadim Gimpelson authored Mar 17, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Co-authored-by: Pavani Majety <pavanimajety@gmail.com>
```
  6c1cfbad
- [BugFix] Correct max memory usage for multiple KV-cache groups (#36030) · 45f526d6
  Harry Huang authored Mar 17, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  45f526d6
- Fix some Mistral parser issues (#37209) · 5db91f0a
  Julien Denize authored Mar 17, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5db91f0a
16 Mar, 2026 26 commits
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
- [CI/Build] Add common tool call parser test suite (#27599) · 7a49742b
  Ben Browning authored Mar 16, 2026
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  7a49742b
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
- Fix EagleMistralLarge3Model initialization (#37232) · 7961486a
  Julien Denize authored Mar 16, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  7961486a
- [CI] Stabilize multinode DP internal LB completion tests (#36356) · 4f9b14c2
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4f9b14c2
- [Doc] Clarify schema enforcement behavior for tool_choice modes (#37064) · 31a458c0
  Yuchen Fama authored Mar 16, 2026
```
Signed-off-by: yfama <yuchengu@gmail.com>
```
  31a458c0
- [Benchmark] Improvements to attention benchmark script (#37115) · a3a51d20
  Wei Zhao authored Mar 16, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  a3a51d20
- [Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448) · e5b80760
  EdalatiAli authored Mar 16, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
```
  e5b80760
- Fix eplb nvfp4 experts hook (#37217) · fd4d9630
  Elvir Crnčević authored Mar 16, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Elvir Crncevic <elvir@anthropic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  fd4d9630
- [Bugfix] opcheck false mutation error in rms_norm_per_block_quant (#36688) (#36779) · c0f01191
  Krish Gupta authored Mar 17, 2026
```
Signed-off-by: Krish Gupta <krishom70@gmail.com>
```
  c0f01191
- [compile] Enable mega aot artifact for torch 2.12+. (#37198) · e6ae4b1b
  Zhengxu Chen authored Mar 16, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  e6ae4b1b
- [Bugfix][MultiConnector] Fix MultiConnector for SupportsHMA sub-connectors (#36549) · 2dccb38f
  zhanqiuhu authored Mar 16, 2026
  
  2dccb38f
- [BUGFIX][Mamba] Use uint64 for address in KVBlockZeroer (#37197) · d1572160
  Kunshang Ji authored Mar 17, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  d1572160
- [Misc] Add `float16` to `CacheDType` (#37199) · 93f3c8e5
  Matthew Bonanni authored Mar 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  93f3c8e5
- [CI][BugFix][MORI][AMD] Add transfer_id to kv transfer params for test (#37213) · 2cc26c3a
  rasmith authored Mar 16, 2026
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2cc26c3a
- [Refactor] Consolidate GPT-OSS reasoning parser tests (#36915) · dfa8852d
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  dfa8852d
- [torch.compile][BE] Modify cudagraph callable to check for is_forward_context_set (#36288) · 714c6e0e
  Lucas Kabela authored Mar 16, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  714c6e0e
- [Bugfix] Fix render server crash for quantized models on CPU-only hosts (#37215) · 0fefd00e
  Sage authored Mar 16, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  0fefd00e
- [PD][Nixl] Add support for hybrid SSM-FA models (#36687) · f5c081d4
  Nicolò Lucchesi authored Mar 16, 2026
  
  f5c081d4
- [MTP][Sparse MLA] Take advantage of native MTP support in indexer when possible (#36982) · c88ea833
  Matthew Bonanni authored Mar 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  c88ea833
- Add simple granite4 tool parser (#36827) · 9f9ecff4
  Max de Bayser authored Mar 16, 2026
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  9f9ecff4
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
- [Bugfix] Make siglip/clip compatible with transformers v5 (#37200) · 55e6d3d5
  Raushan Turganbay authored Mar 16, 2026
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  55e6d3d5
- [Bugfix] Add error handling for FINISHED_ERROR in OpenAIServing (#37148) · 6682c231
  Chauncey authored Mar 17, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  6682c231
- [Bugfix] Relax TRTLLM KV cache contiguity assertion for cross-layer layout (#34158) · 5ae685c1
  Itay Etelis authored Mar 16, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
  5ae685c1
- [Compile] Fix compile warning `st256_cs` in `cuda_vec_utils.cuh` (#36693) · ce8cf916
  Wentao Ye authored Mar 16, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ce8cf916