Commits · 3bbe2e1e6e36c87b49eff3919c6bb1fa93df2a4d · OpenDAS / vllm_cscc · GitLab

23 Mar, 2026 3 commits
- [Test] Consolidate tool parser unit tests to tests/tool_parsers (#37834) · 3bbe2e1e
  Ben Browning authored Mar 23, 2026
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  3bbe2e1e
- always use `embed&token_classify` for bge-m3 (#37632) · 6e04e793
  Augusto Yao authored Mar 23, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  6e04e793
- Fix AudioFlamingo3/MusicFlamingo HF parity and RoTE handling (#37643) · e7767ecc
  Lasha Koroshinadze authored Mar 22, 2026
```
Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
```
  e7767ecc
22 Mar, 2026 8 commits
- [Test] Only Run MLA model when user explicitly set for batch invariance (#37719) · eaf49786
  Wentao Ye authored Mar 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eaf49786
- [ROCm][CI] Stabilize ROCm speech-to-text translation test with lower min acc threshold (#37723) · cd1242d8
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  cd1242d8
- [MoE] Move PF Methods to Folder (#35927) · 4383f153
  Robert Shaw authored Mar 22, 2026
  
  4383f153
- [ROCm][CI] get_cu_count was renamed to num_compute_units in #35042 (#37764) · 6ecba840
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  6ecba840
- [ROCm][CI] Fix MEGA_AOT_ARTIFACT fallback when PyTorch < 2.10.0 lacks AOT support (#37763) · 3b06c55c
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3b06c55c
- [CI] Skip ISAAC multimodal tests due to broken upstream HF model weights (#37781) · c862481c
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c862481c
- [ROCm][CI] Add large_gpu_mark to test_max_tokens_none for ROCm (#37717) · c86b17cf
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c86b17cf
- [Bugfix] Fix pooling non-determinism from pinned prompt_lens aliasing (#37775) · 66f927f2
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  66f927f2
21 Mar, 2026 9 commits
- [MoE] Move FlashInfer CuteDSL experts into fused_moe/experts/ (#37759) · 6b2fa3a7
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
```
  6b2fa3a7
- [Quantization][Deprecation] Remove PTPC FP8 (#32700) · eeee5b26
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  eeee5b26
- Add tensor IPC transfer mechanism for multimodal data (#32104) · 80b70884
  Brandon Pelfrey authored Mar 21, 2026
```
Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com>
Signed-off-by: Brandon Pelfrey <brandonpelfrey@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  80b70884
- [Hybrid] calling get_mamba_groups() once at MambaCopyBuffers.create() (#37318) · 298e5108
  Francesco Fusco authored Mar 21, 2026
```
Signed-off-by: Francesco Fusco <ffu@zurich.ibm.com>
```
  298e5108
- [ROCm][CI] Mark gemma3 as large GPU test to avoid OOM on MI250 (#37610) · 0d50fa1d
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  0d50fa1d
- Revert "[compile] Initialize passes at VllmBackend init" (#37733) · 1fa1e53a
  Simon Mo authored Mar 20, 2026
  
  1fa1e53a
- [ROCm][CI] Guard CudaPlatform/RocmPlatform imports to fix test collection on... · 3ffa5200
  Andreas Karatzas authored Mar 20, 2026
```
[ROCm][CI] Guard CudaPlatform/RocmPlatform imports to fix test collection on cross-platform builds (#37617)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3ffa5200
- [MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189
  Yongye Zhu authored Mar 20, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  87bd9189
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
20 Mar, 2026 20 commits
- [Model Runner V2] Support Streaming Inputs (#37028) · 85f671b8
  Santino Ramos authored Mar 20, 2026
```
Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>
```
  85f671b8
- [Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605) · 4f16ebbb
  Vadim Gimpelson authored Mar 20, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  4f16ebbb
- [compile] Initialize passes at VllmBackend init (#35216) · 12fd17eb
  Angela Yi authored Mar 20, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  12fd17eb
- [Attention] Support distinguishing between short extends and decodes (#37303) · e1d85e5c
  Lucas Wilkinson authored Mar 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e1d85e5c
- [Perf] Eliminate redundant SparseMatrix creation in gpt_oss_triton_kernels (#37683) · d0532bf3
  Xin Yang authored Mar 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d0532bf3
- [ROCm][CI] Fix accuracy for llama-nemotron-vl pooling tests (#37613) · fb4e8bf4
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  fb4e8bf4
- Fix various config related issues for Transformers v5 (#37681) · 6ade4bc5
  Harry Mellor authored Mar 20, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6ade4bc5
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6
- [ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709) · 1779c098
  L.B.R. authored Mar 20, 2026
```
Signed-off-by: L.B.R. <lbr@mmonad.com>
Co-authored-by: L.B.R. <lbr@mmonad.com>
```
  1779c098
- [Model] Add LFM2-ColBERT-350M support (#37528) · 8b6c6b95
  Ilya Boytsov authored Mar 20, 2026
```
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
```
  8b6c6b95
- Fix attribute error in `isaac_patch_hf_runner` (#37685) · 9f6d9dd3
  Harry Mellor authored Mar 20, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9f6d9dd3
- [Refactor] Relocate tests from tests/v1/entrypoints/ to tests/entrypoints/ (#37500) · b4c1aef2
  Flora Feng authored Mar 20, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  b4c1aef2
- [Refactor] Move serve entrypoint tests under tests/entrypoints/serve/ (#37595) · 6050b93b
  Flora Feng authored Mar 20, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  6050b93b
- [ROCm][CI] Fix granite_speech test for gfx90a by selecting compatible attention backend (#37611) · 5a4a1795
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  5a4a1795
- [ROCm][CI] Update GSM8K eval config to use fp8-and-mixed models list (#37619) · 9cfd4ebb
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9cfd4ebb
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
- [Refactor] Relocate entrypoint tests to match serving code structure (#37593) · e2d1c8b5
  Flora Feng authored Mar 20, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  e2d1c8b5
- [V0 Deprecation] Deprecate --disable-frontend-multiprocessing (#37612) · 9040151f
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  9040151f
- [Bugfix][LoRA] Fix Qwen35 LoRA (#36976) · 8fbe3f30
  Jee Jee Li authored Mar 20, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8fbe3f30