Commits · 87bd91892f8c63ed9aeb2ad2e701472ead8be84c · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "e01ab595d897698c9a5fe9eaebd983eb3e23470a"

21 Mar, 2026 2 commits
- [MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189
  Yongye Zhu authored Mar 20, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  87bd9189
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
20 Mar, 2026 17 commits
- [Refactor] Remove unused dead code (#36171) · b3d0b379
  Wentao Ye authored Mar 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b3d0b379
- [Model Runner V2] Support Streaming Inputs (#37028) · 85f671b8
  Santino Ramos authored Mar 20, 2026
```
Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>
```
  85f671b8
- [Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605) · 4f16ebbb
  Vadim Gimpelson authored Mar 20, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  4f16ebbb
- [Model] Update Kimi-K25 and Isaac processors to fit HF-style (#37693) · 37aadf62
  Cyrus Leung authored Mar 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  37aadf62
- [Bugfix] Disable --calculate-kv-scales for hybrid GDN/Mamba+Attention… (#37565) · d7d2b5e4
  Le Yang authored Mar 21, 2026
```
Signed-off-by: Young-Leo <562593859@qq.com>
```
  d7d2b5e4
- [Perf] Eliminate redundant SparseMatrix creation in gpt_oss_triton_kernels (#37683) · d0532bf3
  Xin Yang authored Mar 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d0532bf3
- [Pixtral] Enable Pixtral language model support Eagle3 (#37182) · aa84e43c
  Rémi Delacourt authored Mar 20, 2026
```
Signed-off-by: remi <remi@mistral.ai>
```
  aa84e43c
- [Bugfix] Fix ConchLinearKernel channelwise quantization (group_size=-1) (#37329) · 5e806bcf
  Matthias Gehre authored Mar 20, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  5e806bcf
- [Bugfix] Reject channelwise quantization (group_size <= 0) in ExllamaLinearKernel (#37331) · 56a62c31
  Matthias Gehre authored Mar 20, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  56a62c31
- [ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709) · 1779c098
  L.B.R. authored Mar 20, 2026
```
Signed-off-by: L.B.R. <lbr@mmonad.com>
Co-authored-by: L.B.R. <lbr@mmonad.com>
```
  1779c098
- [ROCm][Quantization] make quark ocp mx dtype parser robust for weight-only quantization (#36232) · 44eea10f
  xuebwang-amd authored Mar 20, 2026
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  44eea10f
- [Model] Add LFM2-ColBERT-350M support (#37528) · 8b6c6b95
  Ilya Boytsov authored Mar 20, 2026
```
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
```
  8b6c6b95
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
- [PluggableLayer][MM] Add PluggableLayer for CustomQwen2Decoder (#37293) · 0674d1fe
  Wangbei25 authored Mar 20, 2026
```
Signed-off-by: Wangbei25 <wangbei41@huawie.com>
Signed-off-by: Wangbei25 <wangbei41@huawei.com>
Co-authored-by: Wangbei25 <wangbei41@huawie.com>
```
  0674d1fe
- [Model] Refactor Step3-VL processor to HF style (#37579) · 30108fc8
  Cyrus Leung authored Mar 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  30108fc8
- [Bugfix][LoRA] Fix Qwen35 LoRA (#36976) · 8fbe3f30
  Jee Jee Li authored Mar 20, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8fbe3f30
- [Feat] Enable CompressedTensorW4A8Int for XPU (#37207) · 47b7af0d
  Tianmu Li authored Mar 19, 2026
```
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
```
  47b7af0d
19 Mar, 2026 13 commits
- Fix AttributeError in Qwen3.5 GDN layers with quantized models (#37448) · 4120a05f
  Jim Smith authored Mar 19, 2026
```
Signed-off-by: Jim Smith <jim@joshua8.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
```
  4120a05f
- [MoE Refactor] Rename "naive" all2all backend (#36294) · 91be5f9b
  bnellnm authored Mar 19, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  91be5f9b
- [MoE Refactor] DefaultMoERunner simplifcation (#33049) · 9279c59a
  bnellnm authored Mar 19, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  9279c59a
- [Bugfix] Fix AttributeError when serving MXFP8 models with DeepGEMM installed (#37358) · daa05bf3
  EdalatiAli authored Mar 19, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  daa05bf3
- [torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid... · 7769b583
  Lucas Kabela authored Mar 19, 2026
```
[torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid cache conflict (#37345)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  7769b583
- [Misc] Cleanup more configs and processors (#37560) · 657855ab
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  657855ab
- [Bug] Fix fp8 trtllm MoE modular kernel supported routing methods (#37346) · e27b8ba3
  Wei Zhao authored Mar 19, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  e27b8ba3
- [Misc] Clean up processing logic (#37541) · 9515c208
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9515c208
- [Model] Remove unnecessary `get_language_model` (#37545) · 7a6ebcbf
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7a6ebcbf
- [Bugfix] Fix Nemotron Parse loading (#37407) · 765e4610
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  765e4610
- [Bugfix][ROCm] Fix MoRI + AITER FP8 dispatch compatibility for defer_input_quant (#37418) · 6a9cceb2
  Duyi-Wang authored Mar 19, 2026
```
Signed-off-by: Duyi-Wang <duyi.wang@amd.com>
```
  6a9cceb2
- Support temporal compression for Nemotron-3-VL videos (#36808) · 0b6d5262
  Collin McCarthy authored Mar 19, 2026
```
Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
```
  0b6d5262
- [BUG] Exclude SKIP_TENSORS from get_layer_size() + new weight sync example for dpep (#37334) · 5f82706a
  Aaron Hao authored Mar 18, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  5f82706a
18 Mar, 2026 8 commits
- [Bugfix] Remove assertion for NVFP4 scale dynamic range (#37465) · 9482b0b0
  Michael Goin authored Mar 18, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  9482b0b0
- [LoRA][BugFix] Fix skipped LoRA adapters for Mistral3 (#36928) · 5bc1da14
  Woosuk Kwon authored Mar 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  5bc1da14
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- chunk parakeet into 30s clips to prevent OOMs on long audios (#36671) · 6ae4c8d6
  Netanel Haber authored Mar 18, 2026
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  6ae4c8d6
- [Bugfix] Fix ROCm crash in qwen3_next multi-stream events (#36795) (#37427) · a913b612
  JartX authored Mar 18, 2026
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  a913b612
- [Bugfix] Fix incorrect use of merge_size in Qwen3-VL video timestamp calculation (#37439) · 738d0a28
  Chengyu Fang authored Mar 19, 2026
```
Signed-off-by: chengyufang <cnyvfang@outlook.com>
```
  738d0a28
- [Model] Remove unnecessary processor definition for Nemotron Parse (#37456) · 7476d148
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7476d148
- [Misc] Clean up model registry (#37457) · f3732bd9
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f3732bd9