Commits · 7a6ebcbfcf2e74876d8493903d444625cd221e7e · OpenDAS / vllm_cscc

"tests/models/quantization/test_awq.py" did not exist on "51c2e1fcef59ca42b378c433997c77affd114d30"

19 Mar, 2026 5 commits
- [Model] Remove unnecessary `get_language_model` (#37545) · 7a6ebcbf
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7a6ebcbf
- [Bugfix] Fix Nemotron Parse loading (#37407) · 765e4610
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  765e4610
- [Bugfix][ROCm] Fix MoRI + AITER FP8 dispatch compatibility for defer_input_quant (#37418) · 6a9cceb2
  Duyi-Wang authored Mar 19, 2026
```
Signed-off-by: Duyi-Wang <duyi.wang@amd.com>
```
  6a9cceb2
- Support temporal compression for Nemotron-3-VL videos (#36808) · 0b6d5262
  Collin McCarthy authored Mar 19, 2026
```
Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
```
  0b6d5262
- [BUG] Exclude SKIP_TENSORS from get_layer_size() + new weight sync example for dpep (#37334) · 5f82706a
  Aaron Hao authored Mar 18, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  5f82706a
18 Mar, 2026 18 commits
- [Bugfix] Remove assertion for NVFP4 scale dynamic range (#37465) · 9482b0b0
  Michael Goin authored Mar 18, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  9482b0b0
- [LoRA][BugFix] Fix skipped LoRA adapters for Mistral3 (#36928) · 5bc1da14
  Woosuk Kwon authored Mar 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  5bc1da14
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- chunk parakeet into 30s clips to prevent OOMs on long audios (#36671) · 6ae4c8d6
  Netanel Haber authored Mar 18, 2026
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  6ae4c8d6
- [Bugfix] Fix ROCm crash in qwen3_next multi-stream events (#36795) (#37427) · a913b612
  JartX authored Mar 18, 2026
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  a913b612
- [Bugfix] Fix incorrect use of merge_size in Qwen3-VL video timestamp calculation (#37439) · 738d0a28
  Chengyu Fang authored Mar 19, 2026
```
Signed-off-by: chengyufang <cnyvfang@outlook.com>
```
  738d0a28
- [Model] Remove unnecessary processor definition for Nemotron Parse (#37456) · 7476d148
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7476d148
- [Misc] Clean up model registry (#37457) · f3732bd9
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f3732bd9
- [Perf] Add tuned triton moe config for Qwen3.5 H200, 9.9% E2E throughput improvement (#37340) · 0ef7f790
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0ef7f790
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
- standardize load_weights using AutoWeightsLoader for kimi_linear and minimax_text_01 (#37371) · 17808394
  XLiu-2000 authored Mar 18, 2026
```
Signed-off-by: XuLiu <xuliu40@gmail.com>
Co-authored-by: XuLiu <xuliu40@gmail.com>
```
  17808394
- [Perf] Eliminate padding and slicing op for GPT-OSS with Flashinfer MXFP4 MXFP8 MoE (#30647) · 296839a1
  elvischenv authored Mar 18, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  296839a1
- [Log] Reduce duplicate log (#37313) · c373b5c0
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c373b5c0
- [2/3] Refactor InternVL-based processors (#37324) · 99267c23
  Cyrus Leung authored Mar 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99267c23
- [Model] Enable LoRA support for tower and connector in H2OVL (#31696) · cef1f302
  Shwetha Poojary authored Mar 18, 2026
```
Signed-off-by: shwetha-s-poojary <shwetha.s-poojary@ibm.com>
```
  cef1f302
- [Bugfix] Fix EP weight filter breaking EPLB and NVFP4 accuracy (#37322) · 17c47fb8
  Elvir Crnčević authored Mar 18, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
  17c47fb8
- [Perf] Enable dual stream execution of input projection for Qwen3 (#36795) · f1740006
  Xin Yang authored Mar 17, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  f1740006
- [Performance] Add --enable-ep-weight-filter CLI option (#37351) · 761e0aa7
  Roy Wang authored Mar 18, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  761e0aa7
17 Mar, 2026 15 commits
- [Kernel] Add non-gated support for NVFP4 CUTLASS MoE (#37320) · 09e4576f
  Michael Goin authored Mar 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  09e4576f
- [Model] Add ColQwen3.5 4.5B support (#36887) · c0745a85
  Athrael Soju authored Mar 17, 2026
```
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c0745a85
- [Models] Cohere ASR (#35809) · b5ca9c35
  Ekagra Ranjan authored Mar 17, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  b5ca9c35
- [Bugfix] Rescale NVFP4 weight scales to fix BF16 dequant underflow (#34577) · 24575899
  Chao-Ju Chen authored Mar 18, 2026
```
Signed-off-by: ricky-chaoju <ricky.chen@infinirc.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  24575899
- [Model] Remove unused `handle_oov_mm_token` (#37321) · 51f0acda
  Cyrus Leung authored Mar 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51f0acda
- [Torch 2.11] Guard torch._C._cpu attribute checks for forward compatibility (#35673) · 68f783a7
  Andrey Talman authored Mar 17, 2026
```
Signed-off-by: atalman <atalman@fb.com>
```
  68f783a7
- [Bugfix] Standardize custom HF Processor init (#37289) · c781fbba
  Cyrus Leung authored Mar 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c781fbba
- [`UltraVox`] Fix output type (#37224) · 2ff0ad96
  Anton Vlasjuk authored Mar 17, 2026
```
Signed-off-by: vasqu <antonprogamer@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2ff0ad96
- [1/2] Move InternVL-based processors (#37260) · f3403243
  Cyrus Leung authored Mar 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f3403243
- Bugfix for offloading+prefetch for GLM-4.7-FP8 (#37178) · 2660b928
  sfbemerk authored Mar 17, 2026
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
```
  2660b928
- [Feature]: Support for multiple embedding types in a single inference call (#35829) · 9c7cab5e
  Augusto Yao authored Mar 17, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  9c7cab5e
- Fix infinite recursive search issue in quark.py (#32779) · 24b4272a
  xiao-llm authored Mar 17, 2026
```
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
Signed-off-by: Xiao Yu <xiao.yu.dc@outlook.com>
Signed-off-by: kimheesu <wlskaka4@gmail.com>
Co-authored-by: Yanwen Lin <lyw1124278064@gmail.com>
Co-authored-by: Kim Hee Su <wlskaka4@gmail.com>
```
  24b4272a
- [Bugfix] Fix NemotronH MTP + Chunked Prefill (#35447) · 8a680463
  Benjamin Chislett authored Mar 17, 2026
  
  8a680463
- [Bugfix] Fix loading Music Flamingo (#35535) · 20b14095
  Nick Cao authored Mar 17, 2026
```
Signed-off-by: Nick Cao <ncao@redhat.com>
```
  20b14095
- Add ability to replace oot ops when using lora (#37181) · 0a0a1a19
  Kyuyeun Kim authored Mar 16, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  0a0a1a19
16 Mar, 2026 2 commits
- Fix EagleMistralLarge3Model initialization (#37232) · 7961486a
  Julien Denize authored Mar 16, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  7961486a
- [Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448) · e5b80760
  EdalatiAli authored Mar 16, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
```
  e5b80760