Commits · a913b612d8a85a926c50815adb969056f10b62e2 · OpenDAS / vllm_cscc

"src/vscode:/vscode.git/clone" did not exist on "b51c15626b705b459b933d67e3f7a76f76c6c2ec"

18 Mar, 2026 14 commits
- [Bugfix] Fix ROCm crash in qwen3_next multi-stream events (#36795) (#37427) · a913b612
  JartX authored Mar 18, 2026
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  a913b612
- [Bugfix] Fix incorrect use of merge_size in Qwen3-VL video timestamp calculation (#37439) · 738d0a28
  Chengyu Fang authored Mar 19, 2026
```
Signed-off-by: chengyufang <cnyvfang@outlook.com>
```
  738d0a28
- [Model] Remove unnecessary processor definition for Nemotron Parse (#37456) · 7476d148
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7476d148
- [Misc] Clean up model registry (#37457) · f3732bd9
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f3732bd9
- [Perf] Add tuned triton moe config for Qwen3.5 H200, 9.9% E2E throughput improvement (#37340) · 0ef7f790
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0ef7f790
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
- standardize load_weights using AutoWeightsLoader for kimi_linear and minimax_text_01 (#37371) · 17808394
  XLiu-2000 authored Mar 18, 2026
```
Signed-off-by: XuLiu <xuliu40@gmail.com>
Co-authored-by: XuLiu <xuliu40@gmail.com>
```
  17808394
- [Perf] Eliminate padding and slicing op for GPT-OSS with Flashinfer MXFP4 MXFP8 MoE (#30647) · 296839a1
  elvischenv authored Mar 18, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  296839a1
- [Log] Reduce duplicate log (#37313) · c373b5c0
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c373b5c0
- [2/3] Refactor InternVL-based processors (#37324) · 99267c23
  Cyrus Leung authored Mar 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99267c23
- [Model] Enable LoRA support for tower and connector in H2OVL (#31696) · cef1f302
  Shwetha Poojary authored Mar 18, 2026
```
Signed-off-by: shwetha-s-poojary <shwetha.s-poojary@ibm.com>
```
  cef1f302
- [Bugfix] Fix EP weight filter breaking EPLB and NVFP4 accuracy (#37322) · 17c47fb8
  Elvir Crnčević authored Mar 18, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
  17c47fb8
- [Perf] Enable dual stream execution of input projection for Qwen3 (#36795) · f1740006
  Xin Yang authored Mar 17, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  f1740006
- [Performance] Add --enable-ep-weight-filter CLI option (#37351) · 761e0aa7
  Roy Wang authored Mar 18, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  761e0aa7
17 Mar, 2026 15 commits
- [Kernel] Add non-gated support for NVFP4 CUTLASS MoE (#37320) · 09e4576f
  Michael Goin authored Mar 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  09e4576f
- [Model] Add ColQwen3.5 4.5B support (#36887) · c0745a85
  Athrael Soju authored Mar 17, 2026
```
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c0745a85
- [Models] Cohere ASR (#35809) · b5ca9c35
  Ekagra Ranjan authored Mar 17, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  b5ca9c35
- [Bugfix] Rescale NVFP4 weight scales to fix BF16 dequant underflow (#34577) · 24575899
  Chao-Ju Chen authored Mar 18, 2026
```
Signed-off-by: ricky-chaoju <ricky.chen@infinirc.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  24575899
- [Model] Remove unused `handle_oov_mm_token` (#37321) · 51f0acda
  Cyrus Leung authored Mar 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51f0acda
- [Torch 2.11] Guard torch._C._cpu attribute checks for forward compatibility (#35673) · 68f783a7
  Andrey Talman authored Mar 17, 2026
```
Signed-off-by: atalman <atalman@fb.com>
```
  68f783a7
- [Bugfix] Standardize custom HF Processor init (#37289) · c781fbba
  Cyrus Leung authored Mar 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c781fbba
- [`UltraVox`] Fix output type (#37224) · 2ff0ad96
  Anton Vlasjuk authored Mar 17, 2026
```
Signed-off-by: vasqu <antonprogamer@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2ff0ad96
- [1/2] Move InternVL-based processors (#37260) · f3403243
  Cyrus Leung authored Mar 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f3403243
- Bugfix for offloading+prefetch for GLM-4.7-FP8 (#37178) · 2660b928
  sfbemerk authored Mar 17, 2026
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
```
  2660b928
- [Feature]: Support for multiple embedding types in a single inference call (#35829) · 9c7cab5e
  Augusto Yao authored Mar 17, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  9c7cab5e
- Fix infinite recursive search issue in quark.py (#32779) · 24b4272a
  xiao-llm authored Mar 17, 2026
```
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
Signed-off-by: Xiao Yu <xiao.yu.dc@outlook.com>
Signed-off-by: kimheesu <wlskaka4@gmail.com>
Co-authored-by: Yanwen Lin <lyw1124278064@gmail.com>
Co-authored-by: Kim Hee Su <wlskaka4@gmail.com>
```
  24b4272a
- [Bugfix] Fix NemotronH MTP + Chunked Prefill (#35447) · 8a680463
  Benjamin Chislett authored Mar 17, 2026
  
  8a680463
- [Bugfix] Fix loading Music Flamingo (#35535) · 20b14095
  Nick Cao authored Mar 17, 2026
```
Signed-off-by: Nick Cao <ncao@redhat.com>
```
  20b14095
- Add ability to replace oot ops when using lora (#37181) · 0a0a1a19
  Kyuyeun Kim authored Mar 16, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  0a0a1a19
16 Mar, 2026 11 commits
- Fix EagleMistralLarge3Model initialization (#37232) · 7961486a
  Julien Denize authored Mar 16, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  7961486a
- [Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448) · e5b80760
  EdalatiAli authored Mar 16, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
```
  e5b80760
- Fix eplb nvfp4 experts hook (#37217) · fd4d9630
  Elvir Crnčević authored Mar 16, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Elvir Crncevic <elvir@anthropic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  fd4d9630
- [torch.compile][BE] Modify cudagraph callable to check for is_forward_context_set (#36288) · 714c6e0e
  Lucas Kabela authored Mar 16, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  714c6e0e
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
- Remove unused EVS functions in qwen3_vl.py (#37183) · 43a73f85
  Tianyu Guo authored Mar 16, 2026
```
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
```
  43a73f85
- [Models][Qwen3 ViT] Keep `max_seqlen` on CPU to prevent D2H sync (#37139) · f9e6db30
  Lukas Geiger authored Mar 16, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f9e6db30
- [Performance] Add prefetch for checkpoints to OS page cache (#36012) · f5e59ee7
  Artem Perevedentsev authored Mar 16, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  f5e59ee7
- Fix text only inputs for MRoPE models with the Transformers modelling backend (#37055) · ad041c79
  Harry Mellor authored Mar 16, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ad041c79
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
- Fix pipeline parallel with multimodal models with the Transformers modelling backend (#37057) · 122f75d9
  Harry Mellor authored Mar 16, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  122f75d9