Commits · c781fbbab3c52551aa565a0f2e9052107447bdb7 · OpenDAS / vllm_cscc · GitLab

17 Mar, 2026 32 commits
- [Bugfix] Standardize custom HF Processor init (#37289) · c781fbba
  Cyrus Leung authored Mar 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c781fbba
- [BugFix] PyTorch Compilation Tests should error if any test fails (#37300) · 979ff44c
  Richard Zou authored Mar 17, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  979ff44c
- [Bugfix] Fix DP MTP Dummy Run (#35243) · f63ed7b5
  Benjamin Chislett authored Mar 17, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  f63ed7b5
- [openapi] remove redundant exception stack trace[4/N] (#37157) · c9e50962
  Ning Xie authored Mar 17, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c9e50962
- [`UltraVox`] Fix output type (#37224) · 2ff0ad96
  Anton Vlasjuk authored Mar 17, 2026
```
Signed-off-by: vasqu <antonprogamer@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2ff0ad96
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
- [Misc][LoRA] Add --lora-target-modules to restrict LoRA to specific modules (#34984) · 3717a4dd
  Bhoomit authored Mar 17, 2026
```
Signed-off-by: Bhoomit Vasani <bhoomit.2010@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3717a4dd
- Fix Phi3 test that fails with Transformers v5 (#37298) · ecfcdd2c
  Harry Mellor authored Mar 17, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ecfcdd2c
- [Bugfix] Fix unclean shutdown crash with AllReduce Fusion workspace (#36955) · c25dbc2d
  Siew's Capital Jarvis authored Mar 17, 2026
```
Signed-off-by: Jarvis <brayden.stanley.0127@gmail.com>
```
  c25dbc2d
- pick up tuned prefill configs for FP8 FA3 (#36265) · 77d2a5f1
  Jonas M. Kübler authored Mar 17, 2026
```
Signed-off-by: Jonas M. Kübler <44084297+jmkuebler@users.noreply.github.com>
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  77d2a5f1
- [Frontend] Complete OpenAI render delegation (#37287) · 59192dfd
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  59192dfd
- [Misc] Use VLLMValidationError in batch, pooling, and tokenize protocol validators (#36256) · 56cb1baa
  Umut Polat authored Mar 17, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  56cb1baa
- [1/2] Move InternVL-based processors (#37260) · f3403243
  Cyrus Leung authored Mar 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f3403243
- Bugfix for offloading+prefetch for GLM-4.7-FP8 (#37178) · 2660b928
  sfbemerk authored Mar 17, 2026
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
```
  2660b928
- Add gigachat 3.1 tool parser + fix gigachat3 tool parser (#36664) · 293f036e
  Viacheslav authored Mar 17, 2026
```
Signed-off-by: Viacheslav Barinov <viacheslav.teh@gmail.com>
```
  293f036e
- [perf][connector] optimize build_connector_meta when host buffer transfer is not used (#37165) · 0fb142a4
  youkaichao authored Mar 17, 2026
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0fb142a4
- [Frontend] Delegate tokenization serving preprocessing to OpenAIServingRender (#37266) · 00f8e0d2
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  00f8e0d2
- [Bugfix](xpu): prevent “selected index k out of range” in TP decode path (#37259) · 4af9ed21
  zhao, zhenhui authored Mar 17, 2026
```
Signed-off-by: zhenzhao <zhenzhao@habana.ai>
```
  4af9ed21
- [Feature]: Support for multiple embedding types in a single inference call (#35829) · 9c7cab5e
  Augusto Yao authored Mar 17, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  9c7cab5e
- [Bugfix][ResponsesAPI] Fix crash when tool_choice=required exceeds max_output_tokens (#37258) · 132bfd45
  Chauncey authored Mar 17, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  132bfd45
- Fix infinite recursive search issue in quark.py (#32779) · 24b4272a
  xiao-llm authored Mar 17, 2026
```
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
Signed-off-by: Xiao Yu <xiao.yu.dc@outlook.com>
Signed-off-by: kimheesu <wlskaka4@gmail.com>
Co-authored-by: Yanwen Lin <lyw1124278064@gmail.com>
Co-authored-by: Kim Hee Su <wlskaka4@gmail.com>
```
  24b4272a
- [Bugfix] Fix NemotronH MTP + Chunked Prefill (#35447) · 8a680463
  Benjamin Chislett authored Mar 17, 2026
  
  8a680463
- [Bugfix] Fix loading Music Flamingo (#35535) · 20b14095
  Nick Cao authored Mar 17, 2026
```
Signed-off-by: Nick Cao <ncao@redhat.com>
```
  20b14095
- [Bugfix] dtype mismatch in ngram gpu propose (#37246) · 17c1bdf3
  PatchyTIS authored Mar 17, 2026
```
Signed-off-by: PatchouliTaisa <patchychen@tencent.com>
Co-authored-by: PatchouliTaisa <patchychen@tencent.com>
```
  17c1bdf3
- [Refactor] Relocate responses API tests (#37241) · 3e3d320c
  Flora Feng authored Mar 17, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  3e3d320c
- [ROCm] Fix AttributeError for torch.compiler.skip_all_guards_unsafe on older PyTorch (#37219) · 54a62a79
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  54a62a79
- [Refactor] Relocate completion and chat completion tests (#37125) · 384dc7f7
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  384dc7f7
- [CI] Fix flaky tool_use chat completion tests with deterministic seed (#37027) · f04d5226
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  f04d5226
- Add ability to replace oot ops when using lora (#37181) · 0a0a1a19
  Kyuyeun Kim authored Mar 16, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  0a0a1a19
- Support non-contiguous KV cache in TRTLLM fp8 dequant kernel (#36867) · 6c1cfbad
  Vadim Gimpelson authored Mar 17, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Co-authored-by: Pavani Majety <pavanimajety@gmail.com>
```
  6c1cfbad
- [BugFix] Correct max memory usage for multiple KV-cache groups (#36030) · 45f526d6
  Harry Huang authored Mar 17, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  45f526d6
- Fix some Mistral parser issues (#37209) · 5db91f0a
  Julien Denize authored Mar 17, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5db91f0a
16 Mar, 2026 8 commits
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
- [CI/Build] Add common tool call parser test suite (#27599) · 7a49742b
  Ben Browning authored Mar 16, 2026
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  7a49742b
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
- Fix EagleMistralLarge3Model initialization (#37232) · 7961486a
  Julien Denize authored Mar 16, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  7961486a
- [CI] Stabilize multinode DP internal LB completion tests (#36356) · 4f9b14c2
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4f9b14c2
- [Doc] Clarify schema enforcement behavior for tool_choice modes (#37064) · 31a458c0
  Yuchen Fama authored Mar 16, 2026
```
Signed-off-by: yfama <yuchengu@gmail.com>
```
  31a458c0
- [Benchmark] Improvements to attention benchmark script (#37115) · a3a51d20
  Wei Zhao authored Mar 16, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  a3a51d20
- [Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448) · e5b80760
  EdalatiAli authored Mar 16, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
```
  e5b80760