Commits · 67fc16cd8cf778a30ad0f7619fe77bd85f1d1633 · OpenDAS / vllm_cscc

25 Nov, 2025 9 commits

[Bugfix] If chunked_prefill is disabled, end the scheduling early. (#28911) · 67fc16cd
wang.yuqi authored Nov 25, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
67fc16cd
[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841) · 6330f947
elvischenv authored Nov 25, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
6330f947
[ROCm][CI] Fix test_cudagraph_mode failure in AMD CI (#29367) · ef1f7030
Micah Williamson authored Nov 25, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
ef1f7030

Rémi Delacourt authored Nov 25, 2025


Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Signed-off-by: remi <remi@mistral.ai>

12c007e2

[Bugfix] [ROCm] [UX]: revert Flex attention backend (#29371) · 64deead7
vllmellm authored Nov 25, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
64deead7
Scheduled removal of `guided_*` config fields (#29326) · 316c8492
Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
316c8492

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

[Metrics] Scheduled removal of deprecated metrics (#29330) · 9cf4edae
Mark McLoughlin authored Nov 25, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
9cf4edae

[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for... · 77e10c9c

Pleaplusone authored Nov 25, 2025


[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for extremely long sequence (#28029)
Signed-off-by: ganyi <ygan@amd.com>

77e10c9c

24 Nov, 2025 11 commits

[Hybrid Allocator] Better layer padding strategy for gpt-oss eagle (#29303) · 71df2a57
Chen Zhang authored Nov 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
71df2a57
[Tests] Verify gpt_oss package is installed in harmony tests (#29336) · 84371daf
Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
84371daf

[Multimodal][Qwen3 Omni] Make Qwen3 Omni work with audio-in-video inputs in V1 engine. (#27721) · 839c6b7b

Chenheli Hua authored Nov 24, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

839c6b7b

[MoE][Refactor] Make select_experts a non-static method (#29067) · 8f066146
bnellnm authored Nov 24, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
8f066146

[Bugfix] properly handle nested json with llama3 tool parser (#27701) · 656516c3

Aydin Abiar authored Nov 24, 2025

Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Aydin Abiar <62435714+Aydin-ab@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

656516c3

[Bugfix] [ROCm] [UX] Reorganize ROCm Backend Selection Logic (#26980) · e48b2e68
vllmellm authored Nov 24, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
e48b2e68

Add option to use unbacked, and backed size obl dynamic shapes for more sounds... · 7a228b53

Laith Sakka authored Nov 24, 2025


Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199)
Signed-off-by: Laith Sakka <lsakka@meta.com>

7a228b53

[EPLB] Optimize EPLB for Async Rearrange Experts (#22179) · 2601f18a
WeiQing Chen authored Nov 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: SunChenxiang123 <1291824390@qq.com>
```
2601f18a
[Core] Deprecate `xformers` (#29262) · 0ff70821
Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
0ff70821

[Model] Add OpenCUA-7B support (#29068) · 30854783

Zero authored Nov 24, 2025

Signed-off-by: lim4349 <rockmanzero@naver.com>
Signed-off-by: Zero <rockmanzero@naver.com>
Co-authored-by: Cloud User <ubuntu@a100-80g-4.novalocal>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

30854783

[LoRA] Optimize 3D MoE logic (#29222) · 1073ba68
Jee Jee Li authored Nov 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1073ba68

23 Nov, 2025 4 commits
- [ROCm][CI] Fix "Cannot re-initialize CUDA in forked subprocess" in test_pynccl.py (#29119) · 55c21c88
  Micah Williamson authored Nov 22, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  55c21c88
- [CI/Build][AMD] Add check for flash_att_varlen_func to test_tree_attention.py (#29252) · 3999442f
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  3999442f
- [CI/Build][AMD] Skip test_multi_shared_storage_connector_consistency in... · 71362ffa
  rasmith authored Nov 22, 2025
```
[CI/Build][AMD] Skip test_multi_shared_storage_connector_consistency  in test_multi_connector.py due to hipErrorLaunchFailure  when calling .cpu() (#29253)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  71362ffa
- [Doc] Update more docs with respect to V1 (#29188) · 389aa1b2
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  389aa1b2
22 Nov, 2025 10 commits
- [BugFix] Fix chunked prompt logprobs + preemption (#29071) · 7df331c6
  Nick Hill authored Nov 22, 2025
  
  7df331c6
- [BugFix] Fix returned logprobs with spec decode + prefill chunking (#29216) · d44a63c6
  Nick Hill authored Nov 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d44a63c6
- [Attention] Refactor FA `block_size` limitations to hybrid models only (#29084) · 066209a0
  Nicolò Lucchesi authored Nov 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  066209a0
- [Misc] Further clean up chunked prefill and prefix caching init (#29186) · 5a480258
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a480258
- [CI/Build Don't add FLASHINFER backend in test_cpu_offloading.py (#29229) · 8e22da1d
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  8e22da1d
- [CI/Build] Skip tests that require libcudart in test_lmcache_integration.py (#29228) · a4fdf240
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  a4fdf240
- [responsesAPI] parse reasoning item input (#28248) · 742e9ff6
  Andrew Xia authored Nov 21, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  742e9ff6
- [CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149) · fd65015a
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  fd65015a
- [CI/Build][AMD] Enable Entrypoints Integration Test (Pooling) to run without error on ROCm (#29212) · 6f403501
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  6f403501
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 6 commits

[KV Connector] Fix async connector prefix cache metrics (#28585) · c6fa3895
Mark McLoughlin authored Nov 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
c6fa3895
[BugFix] EPLB + B200 + DeepGEMM : Handle column-major scales tensor (#29162) · 3137991f
Varun Sundar Rabindranath authored Nov 21, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
3137991f

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

[CI] Add batch invariant test to ci (#27842) · 1f400c58
Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1f400c58

[CI/Build] Fix illegal memory access and unsupported test in... · 711241c1

rasmith authored Nov 21, 2025


[CI/Build] Fix illegal memory access and unsupported test in kernels/attention/test_cache.py (#29118)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

711241c1

[V0 deprecation] Remove more V0 references (#29088) · aab0102a
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aab0102a