Commits · bcb6f5947f8acac22f5d1d5fc92a91b06fd57e77 · OpenDAS / vllm_cscc

"lib/llm/vscode:/vscode.git/clone" did not exist on "5755a8dec365b6d13765db18498a4e8ba76fa377"

08 Dec, 2025 2 commits
- [Perf] Remove sync point in vit torch sdpa attn backend (#30232) · bcb6f594
  Dazhi Jiang authored Dec 08, 2025
```
Signed-off-by: Dazhi Jiang <dazhi_jiang@163.com>
```
  bcb6f594
- [ROCm] [Fused Moe EP] Use binary expert mask for aiter fused moe kernel (#29773) · c6df05eb
  Zhiwei authored Dec 08, 2025
```
Signed-off-by: ZhiweiYan-96 <zhiwei.yan@amd.com>
```
  c6df05eb
07 Dec, 2025 5 commits
- [Performance] Fused blockwise quant RMS norm (#27883) · af0444bf
  ElizaWszola authored Dec 07, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
```
  af0444bf
- [Perf] Deepgemm fused layout kernel for activations, 4.3% throughput... · 541a2ef8
  Wentao Ye authored Dec 07, 2025
```
[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  541a2ef8
- [Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09
  Jinzhen Lin authored Dec 07, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  879ddb09
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
06 Dec, 2025 6 commits
- [Model] Move `multimodal_cpu_fields` definition to field config (#30181) · 671427ef
  Cyrus Leung authored Dec 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  671427ef
- [Chore] Deprecate `SupportsMultiModal.merge_by_field_config` (#30170) · c46b932d
  Cyrus Leung authored Dec 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c46b932d
- [Model] Add support for transformer-based Ultravox v0.7 projector (#30089) · e858bc4d
  Peter Salas authored Dec 05, 2025
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  e858bc4d
- fix#30092 Kimi-Linear model loading failure with missing indexer_rotary_emb (#30093) · e3fbb6f1
  Dongjie Zou authored Dec 05, 2025
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
```
  e3fbb6f1
- Fix AWQ MoE marlin check issue in marlin_utils.py for AMD backend (#30102) · c4d62618
  yuttian1 authored Dec 06, 2025
```
Signed-off-by: yuttian1 <yuttian@amd.com>
```
  c4d62618
- [CI/Build][AMD][Quantization] Fix test_int8_kernel.py by updating int8_utils... · dc839ad0
  rasmith authored Dec 05, 2025
```
[CI/Build][AMD][Quantization] Fix test_int8_kernel.py by updating int8_utils to use hip.libdevice.round (#30151)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  dc839ad0
05 Dec, 2025 7 commits

[Bug] Fix vLLM config is not set error (#29999) · 7b5575fa
Wentao Ye authored Dec 05, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
7b5575fa
[Bugfix][llama4_eagle] Fix missing 'lm_head' attribute (#29926) · 962d7038
Divakar Verma authored Dec 05, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
962d7038

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

[Compressed Tensors] Add XPU `wNa16` support (#29484) · 0d8a7d8a
Yi Liu authored Dec 05, 2025
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
0d8a7d8a
[ROCm][MXFP4] Infer w4a4 quant method in rocm aiter fused moe (#29775) · 3628bcaa
Zhiwei authored Dec 05, 2025
```
Signed-off-by: ZhiweiYan-96 <zhiwei.yan@amd.com>
```
3628bcaa

[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override... · 6038b1b0

amitz-nv authored Dec 05, 2025


[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978)
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>

6038b1b0

[Perf] Enable separate shared_experts stream only for CUDA (#30085) · 4470ee2f
Alexander Matveev authored Dec 04, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
4470ee2f

04 Dec, 2025 9 commits
- Access `partial_rotary_factor` from `rope_parameters` (#29966) · e10c84e0
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e10c84e0
- [Bugfix] Fix FP8 MoE LoRA (#29890) · 652ba93d
  Jee Jee Li authored Dec 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  652ba93d
- support qwen3-vl handle requests with embeddings (#30037) · 6dcb07f6
  Tao Yun authored Dec 05, 2025
```
Signed-off-by: taoyun <1069423820@qq.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6dcb07f6
- [Chore] Deprecate `merge_by_field_config` arg (#30035) · b286a311
  Cyrus Leung authored Dec 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b286a311
- Delete HF version of Phi 4 MM (#30049) · 9998ea5b
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9998ea5b
- [Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c
  wang.yuqi authored Dec 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  74c4d80c
- [Misc] Move functions into `PoolingMetadata` (#30027) · 68eb5c8d
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68eb5c8d
- [ROCm] [Bugfix] `compute_attn_mask_seqlen` for qwen3 omni (#29974) · 3f1b0373
  TJian authored Dec 04, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  3f1b0373
- [Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ae2f603
03 Dec, 2025 5 commits

[Kernels] Remove BatchedTritonOrDeepGemmExperts and default fallback to Triton (#29929) · 2902c348

bnellnm authored Dec 03, 2025


Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

2902c348

[Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470) · 19bee6d1

Varun Sundar Rabindranath authored Dec 03, 2025

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

19bee6d1

[refactor] CTMoEMethods to use QuantizationArgs (#28871) · b294e28d

HDCharles authored Dec 03, 2025


Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

b294e28d

[Bugfix][Quantization] Support BF16 tensors on GGUF (#29948) · 42c19496
Tsukasa OI authored Dec 03, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
42c19496

[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing... · a21cd9ed

Isotr0py authored Dec 03, 2025


[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing `merge_by_field_config=True` (#29950)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a21cd9ed

02 Dec, 2025 6 commits
- [BUGFIX] llama_4_scaling wrongly passed to DeepseekAttention (#29908) · 5e5646e2
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5e5646e2
- Fix some more Transformers nightly tests (#29872) · 6fc5841d
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6fc5841d
- feat(model): Add BitsAndBytes quantization support for Qwen3-Omni-MoE (#29896) · a2b053dc
  Navanit Dubey authored Dec 03, 2025
```
Signed-off-by: navanit-git <navanitdubey@gmail.com>
```
  a2b053dc
- [Attention][CUDAGraph] Remove CG padding from attention backends (#29352) · 1d93f116
  Matthew Bonanni authored Dec 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  1d93f116
- [Bugfix] Fix incorrect channel order for idefics3 in edge case (#29881) · 0ec84221
  Isotr0py authored Dec 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0ec84221
- [Bugfix] Fix DeepSeek R1 MTP weight loading (#29545) · 51c57b51
  Matthew Bonanni authored Dec 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  51c57b51