Commits · c781fbbab3c52551aa565a0f2e9052107447bdb7 · OpenDAS / vllm_cscc · GitLab

17 Mar, 2026 15 commits
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
- [Misc][LoRA] Add --lora-target-modules to restrict LoRA to specific modules (#34984) · 3717a4dd
  Bhoomit authored Mar 17, 2026
```
Signed-off-by: Bhoomit Vasani <bhoomit.2010@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3717a4dd
- Fix Phi3 test that fails with Transformers v5 (#37298) · ecfcdd2c
  Harry Mellor authored Mar 17, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ecfcdd2c
- [Frontend] Complete OpenAI render delegation (#37287) · 59192dfd
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  59192dfd
- [1/2] Move InternVL-based processors (#37260) · f3403243
  Cyrus Leung authored Mar 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f3403243
- Add gigachat 3.1 tool parser + fix gigachat3 tool parser (#36664) · 293f036e
  Viacheslav authored Mar 17, 2026
```
Signed-off-by: Viacheslav Barinov <viacheslav.teh@gmail.com>
```
  293f036e
- [Frontend] Delegate tokenization serving preprocessing to OpenAIServingRender (#37266) · 00f8e0d2
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  00f8e0d2
- [Feature]: Support for multiple embedding types in a single inference call (#35829) · 9c7cab5e
  Augusto Yao authored Mar 17, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  9c7cab5e
- [Bugfix][ResponsesAPI] Fix crash when tool_choice=required exceeds max_output_tokens (#37258) · 132bfd45
  Chauncey authored Mar 17, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  132bfd45
- [Bugfix] Fix NemotronH MTP + Chunked Prefill (#35447) · 8a680463
  Benjamin Chislett authored Mar 17, 2026
  
  8a680463
- [Refactor] Relocate responses API tests (#37241) · 3e3d320c
  Flora Feng authored Mar 17, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  3e3d320c
- [Refactor] Relocate completion and chat completion tests (#37125) · 384dc7f7
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  384dc7f7
- [CI] Fix flaky tool_use chat completion tests with deterministic seed (#37027) · f04d5226
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  f04d5226
- Support non-contiguous KV cache in TRTLLM fp8 dequant kernel (#36867) · 6c1cfbad
  Vadim Gimpelson authored Mar 17, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Co-authored-by: Pavani Majety <pavanimajety@gmail.com>
```
  6c1cfbad
- [BugFix] Correct max memory usage for multiple KV-cache groups (#36030) · 45f526d6
  Harry Huang authored Mar 17, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  45f526d6
16 Mar, 2026 25 commits
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
- [CI/Build] Add common tool call parser test suite (#27599) · 7a49742b
  Ben Browning authored Mar 16, 2026
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  7a49742b
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
- [CI] Stabilize multinode DP internal LB completion tests (#36356) · 4f9b14c2
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4f9b14c2
- [Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448) · e5b80760
  EdalatiAli authored Mar 16, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
```
  e5b80760
- [Bugfix] opcheck false mutation error in rms_norm_per_block_quant (#36688) (#36779) · c0f01191
  Krish Gupta authored Mar 17, 2026
```
Signed-off-by: Krish Gupta <krishom70@gmail.com>
```
  c0f01191
- [CI][BugFix][MORI][AMD] Add transfer_id to kv transfer params for test (#37213) · 2cc26c3a
  rasmith authored Mar 16, 2026
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2cc26c3a
- [Refactor] Consolidate GPT-OSS reasoning parser tests (#36915) · dfa8852d
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  dfa8852d
- [PD][Nixl] Add support for hybrid SSM-FA models (#36687) · f5c081d4
  Nicolò Lucchesi authored Mar 16, 2026
  
  f5c081d4
- Add simple granite4 tool parser (#36827) · 9f9ecff4
  Max de Bayser authored Mar 16, 2026
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  9f9ecff4
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
- [Bugfix] Make siglip/clip compatible with transformers v5 (#37200) · 55e6d3d5
  Raushan Turganbay authored Mar 16, 2026
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  55e6d3d5
- [Bugfix] accept redacted thinking blocks in Anthropic messages (#36992) · 0e5a9382
  Benjamin Bartels authored Mar 16, 2026
```
Signed-off-by: Benjamin Bartels <benjaminba@tiglab-ubuntu.ilab.local>
Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Benjamin Bartels <benjaminba@tiglab-ubuntu.ilab.local>
```
  0e5a9382
- [Spec Decode] Update extract_hidden_states to use deferred kv_connector clear (#37013) · 04bf5a35
  Fynn Schmitt-Ulms authored Mar 16, 2026
  
  04bf5a35
- GLM4 tool parser: fix streaming mode (#35208) · bf9a1853
  Robin Nabel authored Mar 16, 2026
```
Signed-off-by: Robin Nabel <opensource@nabel.co>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  bf9a1853
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
- [Bugfix] Fix GDN attention crash with mixed decode/spec-decode batches (#34871) · 116ed130
  haosdent authored Mar 16, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  116ed130
- [Bugfix] Fix Qwen2.5-Omni/Qwen3-Omni use_audio_in_video with multi-video inputs (#37147) · 912fbe95
  Isotr0py authored Mar 16, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  912fbe95
- [Performance][Model Loader] Skip non-local expert weights during EP model loading (#37136) · 821eb80c
  Roy Wang authored Mar 16, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  821eb80c
- [ROCm][CI] Retrying in case of batch variance effects and reducing flakiness (#36442) · a2956a0f
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a2956a0f
- [ROCm] Fix KV copy methods and auto-select attention backend for ROCm (#36845) · 911355e2
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  911355e2
- [Kernel] Add FlashInfer MoE A2A Kernel (#36022) · 2754231b
  leo-cf-tian authored Mar 16, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Leo Tian <lctian@nvidia.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: root <root@lyris0267.lyris.clusters.nvidia.com>
```
  2754231b
- [Model] Add HyperCLOVAX-SEED-Think-14B language model support (#37107) · 2390d442
  bigshanedogg authored Mar 16, 2026
```
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
```
  2390d442
- [ROCm][CI] Fix engine teardown and text normalization to stabilize voxtral test (#37138) · d4c57863
  Andreas Karatzas authored Mar 15, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  d4c57863
- [responsesAPI][ez] add a unit test for SimpleContext logprobs (#37126) · e9163b53
  Andrew Xia authored Mar 15, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  e9163b53