Commits · a5354b3ed24723ac6e351896cc11e16dcee0b701 · OpenDAS / vllm_cscc

27 Sep, 2025 8 commits
- [Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982) · a5354b3e
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  a5354b3e
- [Bugfix] Fix triton import precommit failure (#25803) · f9df8b4a
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  f9df8b4a
- Fix GPTQ model loading in Transformers backend (#25770) · ec152c87
  Harry Mellor authored Sep 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ec152c87
- [Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  27d7638b
- [Bugfix] Add missing `image_size` for phi4_multimodal (#25796) · 17617398
  Xiaohan Zou authored Sep 27, 2025
  
  17617398
- [CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d346ec69
- [Bugfix] Allow Only SDPA Backend for ViT on B200 for Qwen3-VL (#25788) · c242c980
  Wentao Ye authored Sep 26, 2025
  
  c242c980
- [Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (#22872) · f1d53d15
  WeiQing Chen authored Sep 27, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
```
  f1d53d15
26 Sep, 2025 11 commits

Kernel-override Determinism [1/n] (#25603) · dc48ba0c
Bram Wasti authored Sep 26, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
dc48ba0c
[CI] Add E2E Blackwell Quantized MoE Test (#25723) · f708bd49
Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f708bd49

Eagle3 that supports the Minicpm3 model (#24243) · 33f6aaf9

阿丹(adan) authored Sep 27, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: liudan <adan@minicpm.com>
Co-authored-by: liudan <liudan@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>

33f6aaf9

[Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
d4d98998

[Model] Mamba2 varlen refactor (#21467) · 2b6b1d78

Chih-Chieh Yang authored Sep 26, 2025


Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: RishiAstra <40644327+RishiAstra@users.noreply.github.com>

2b6b1d78

[Bugfix] Fix Shared Expert/Zero expert code in FusedMoE.process_chunk (#25698) · dfb9af20

Sage Moore authored Sep 26, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

dfb9af20

[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride... · 99b3a504

Tao He authored Sep 26, 2025


[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride bug in causal_conv_1d. (#25743)
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>

99b3a504

[Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI300X (#25703) · 52621c8f
xaguilar-amd authored Sep 26, 2025
```
Signed-off-by: xaguilar <Xavier.AguilarFruto@amd.com>
```
52621c8f

EVS Support (Video tokens pruning) (#22980) · 392edee3

Eugene Khvedchenya authored Sep 26, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenya@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

392edee3

Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135) · 53a30845

Aleksandr Malyshev authored Sep 25, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>

53a30845

[Refactor] Remove DeepGEMM OP Register (#25710) · 9fe4c2bd
Wentao Ye authored Sep 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
9fe4c2bd

25 Sep, 2025 17 commits
- Fix routing_bias dtype (#25711) · 081b5594
  Shu Wang authored Sep 25, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  081b5594
- [Model] rename NemotronH_Nano_VL -> NemotronH_Nano_VL_V2 (#25708) · 57329a8c
  tomeras91 authored Sep 26, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  57329a8c
- [Optimization] Use a cheaper cache key in `get_model_architecture` (#25682) · 89fa54e6
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  89fa54e6
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
- [Model] Define `merge_by_field_config` MM interface (#25676) · 0ea80c87
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0ea80c87
- Revert "[Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function`... · 916bd920
  Michael Goin authored Sep 25, 2025
```
Revert "[Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function` calling disabled super()" (#25681)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  916bd920
- [Bugfix] Fix InternS1 video processing after Transformers v4.56 (#25644) · 03858e6d
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  03858e6d
- [mypy] Further improve MM type annotations (#25654) · 12c1287d
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  12c1287d
- [Bugfix] Fix Qwen3-VL max_num_video_tokens calculation for video profiling (#25648) · 17b4c668
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  17b4c668
- [Misc] Fix Qwen3-VL `video_grid_thw` typing (#25646) · 7be9ffcd
  Roger Wang authored Sep 25, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  7be9ffcd
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
- Map CwmForCausalLM to llama and LlamaForCausalLM (#25611) · bc092ea8
  Jacob Kahn authored Sep 25, 2025
```
Signed-off-by: Jacob Kahn <jacobkahn1@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  bc092ea8
- [Misc] Simplify PoolerOutput and move to `v1/outputs` (#25629) · 755ed7b0
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  755ed7b0
- [Model] Add LongCat-Flash (#23991) · 845adb3e
  XuruiYang authored Sep 25, 2025
```
Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>
```
  845adb3e
- Enable Fbgemm NVFP4 on Dense models (#25609) · 90b139cf
  Saman A. Pour authored Sep 24, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
```
  90b139cf
- [Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function` calling... · 4492e3a5
  Wentao Ye authored Sep 24, 2025
```
[Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function` calling disabled super() (#25613)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  4492e3a5
- [Kernel] Support DCP for Triton backend (#25132) · 05c19485
  Wei Wei authored Sep 24, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  05c19485
24 Sep, 2025 4 commits
- [Model] Improve DotsOCRForCausalLM (#25466) · 52d0cb84
  Jee Jee Li authored Sep 25, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  52d0cb84
- [Refactor] Use DeepGEMM Col Major TMA Aligned Tensor (#25517) · 1f291412
  Wentao Ye authored Sep 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1f291412
- feat: BF16 FlashInfer Fused Cutlass MOE for Hopper and Blackwell Expert Parallel (#25503) · 6160ba41
  Duncan Moss authored Sep 24, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  6160ba41
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050