Commits · 7e24e5d4d65abbe5ffc7e653fdfd670c7e300944 · OpenDAS / vllm_cscc

11 Dec, 2025 5 commits
- [Deprecation] Remove deprecated task, seed and MM settings (#30397) · 7e24e5d4
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e24e5d4
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9
- [Bugfix] Fix grouped_topk pytorch impl when num_experts can't be grouped properly (#29439) · d1e1fb43
  Divakar Verma authored Dec 10, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  d1e1fb43
- [ROCm] Fix broken import in platform attention backend dispatching (#30432) · b51255f3
  Andreas Karatzas authored Dec 10, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  b51255f3
- Revert "[CI] Add Async Eplb nightly CI tests (#29385)" (#30431) · b4054c8a
  Sage Moore authored Dec 10, 2025
  
  b4054c8a
10 Dec, 2025 24 commits
- [Bugfix] fix confusing OOM errors during v1 init (#28051) · 8580919a
  shivampr authored Dec 10, 2025
```
Signed-off-by: Shivam <shivamprasad91@gmail.com>
Signed-off-by: shivampr <shivampr.dev@gmail.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  8580919a
- fix(shm): Add memory barriers for cross-process shared memory visibility (#30407) · 166ac3c9
  Christina Norman authored Dec 10, 2025
```
Signed-off-by: Christina Holland <hey@christinaholland.com>
Signed-off-by: Christina <truffle@gmail.com>
```
  166ac3c9
- [LMCache] Fix breakage due to new LMCache version (#30216) · 6ccb7bae
  Nick Hill authored Dec 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  6ccb7bae
- [bug] Fix "Current vLLM config is not set." warnings when FlashInfer attention is used (#30241) · eea41804
  Po-Han Huang (NVIDIA) authored Dec 11, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  eea41804
- [Perf] Enable environment cache in EngineCore to enable the feature for... · 9f042ba2
  Jialin Ouyang authored Dec 10, 2025
```
[Perf] Enable environment cache in EngineCore to enable the feature for UniProcExecutor as well (#29289)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  9f042ba2
- {Deprecation] Remove tokenizer setter (#30400) · e72d65b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e72d65b9
- [P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f
  Will Eaton authored Dec 10, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a9e4106f
- [Bugfix] Fix HunyuanOCR cross-image contamination in batch processing (#30344) · e8e8cd73
  Anker authored Dec 10, 2025
```
Signed-off-by: Lennart Brog <lennart.borg@list-ag.de>
Signed-off-by: Anker <20343812+anker-c2@users.noreply.github.com>
```
  e8e8cd73
- [Chore] Delay recent deprecations (#30398) · 253305d5
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  253305d5
- [Misc] Consistent case for `vllm bench serve` results (#30403) · 794a7875
  Matthew Bonanni authored Dec 10, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  794a7875
- [BugFix] Fix `AttributeError: 'MergedColumnParallelLinear' object has no... · aacf0abf
  Lucas Wilkinson authored Dec 10, 2025
```
[BugFix] Fix `AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight_scale'` (#30399)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  aacf0abf
- [Core] Whisper enable `FULL_DECODE_ONLY` CudaGraph (#30072) · c756fb67
  Nicolò Lucchesi authored Dec 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  c756fb67
- [BugFix] Fix minimax m2 model rotary_dim (#30384) · d017bceb
  Roger Young authored Dec 10, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  d017bceb
- [CPU] Support for Whisper (#30062) · cebda2a4
  Aditya Tewari authored Dec 10, 2025
```
Signed-off-by: Aditya Tewari <aditya.tewari@arm.com>
```
  cebda2a4
- [Bugfix] tpu_model_runner: set vllm config context when calling reset_dynamo_cache() (#30331) · 53d2420b
  Daniele authored Dec 10, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
  53d2420b
- [Bugfix] Fix the issue where DeepSeek v3.2 cannot use structured_output (#30371) · 9db78f34
  Chauncey authored Dec 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9db78f34
- [Bugfix] Cache added_vocab to avoid per-token overhead (#30351) · d007387a
  Mingliang Li authored Dec 10, 2025
```
Signed-off-by: limingliang <limingliang@stepfun.com>
Co-authored-by: limingliang <limingliang@stepfun.com>
```
  d007387a
- Fix typos in comments across multiple files (#30345) · 3bdd4266
  Wilson Wu authored Dec 10, 2025
```
Signed-off-by: Wilson Wu <iwilsonwu@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  3bdd4266
- [bugfix][quantization] fix quark qwen3 kv_cache quantization (#30308) · 06462392
  haoyangli-amd authored Dec 10, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
```
  06462392
- [responsesAPI][6] Fix multi turn MCP tokenization (#30230) · c3487aca
  Andrew Xia authored Dec 09, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  c3487aca
- [Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable... · abe93bce
  Lucas Wilkinson authored Dec 09, 2025
```
[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  abe93bce
- [Bugfix] Fix fp8 DeepGemm compilation issues (#30336) · 2e7035dd
  ElizaWszola authored Dec 10, 2025
  
  2e7035dd
- [Bugfix] Fix cuda graph sizes when running with speculative decoding (#30330) · 4c2e10ea
  PatrykSaffer authored Dec 10, 2025
```
Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>
```
  4c2e10ea
- [V1][Spec Decode] Optimize Medusa proposer to avoid GPU-CPU sync (#29723) · 03b5f940
  dongbo910220 authored Dec 10, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  03b5f940
09 Dec, 2025 11 commits

[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block... · 3c680f4a

Charlie Fu authored Dec 09, 2025


[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block quant for Aiter (#25693)
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Charlie Fu <Charlie.Fu@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3c680f4a

[Quantization] FP8 Weight Reloading for Quantized RL Rollout (#28480) · fccd5325
Kyle Sayers authored Dec 09, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
fccd5325

[MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066) · 00e5cbb9

bnellnm authored Dec 09, 2025

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

00e5cbb9

[CI/Build] Make test_mha_attn.py run on correct platform only and check for... · 7618dc97
rasmith authored Dec 09, 2025
```
[CI/Build] Make test_mha_attn.py run on correct platform only and check for flash_attn_varlen_func in layer.py (#29145)
```
7618dc97
[Model][Quantization] Fix / Add GGUF support for Qwen2 MoE models (#30307) · 73a484ca
Tsukasa OI authored Dec 10, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
73a484ca

[BugFix] Fix DeepSeek-R1 hang with DP and MTP (#30119) · 95501a70

Lucas Wilkinson authored Dec 09, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

95501a70

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

[Model Runner V2] Support num NaNs in logits (#30187) · d471b2af
Woosuk Kwon authored Dec 09, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
d471b2af
[Model Runner V2] Fix Triton warning on tl.where (#30355) · 9e6562a3
Woosuk Kwon authored Dec 09, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
9e6562a3
[BugFix] Fix non detected failing tests (#30277) · 0b6a8a30
Ilya Markov authored Dec 09, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
0b6a8a30

[Compile] Fix torch warning `TensorFloat32 tensor cores for float32 matrix... · 83319b44

Wentao Ye authored Dec 09, 2025


[Compile] Fix torch warning `TensorFloat32 tensor cores for float32 matrix multiplication available but not enabled` (#29897)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

83319b44