Commits · afb1e5b380ff623e478d19a246b42b2903b9331f · OpenDAS / vllm_cscc · GitLab

02 Dec, 2025 36 commits
- [CI][ROCm][tests/v1/e2e] Fix multiprocessing launch for the test (#29123) · afb1e5b3
  Divakar Verma authored Dec 02, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  afb1e5b3
- Fix boolean nested params, add dict format support, and enhance plotting for... · 1c593e11
  Copilot authored Dec 02, 2025
```
Fix boolean nested params, add dict format support, and enhance plotting for vllm bench sweep (#29025)
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  1c593e11
- feat(model): Add BitsAndBytes quantization support for Qwen3-Omni-MoE (#29896) · a2b053dc
  Navanit Dubey authored Dec 03, 2025
```
Signed-off-by: navanit-git <navanitdubey@gmail.com>
```
  a2b053dc
- [Attention][CUDAGraph] Remove CG padding from attention backends (#29352) · 1d93f116
  Matthew Bonanni authored Dec 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  1d93f116
- [CI/Build] Fixes missing runtime dependencies (#29822) · 2d613de9
  Benjamin Bartels authored Dec 02, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  2d613de9
- Update AMD-CI testing mirror (as of 2025-12-02) (#29898) · c77b9929
  Alexei-V-Ivanov-AMD authored Dec 02, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  c77b9929
- [Chore]: Reorganize gguf utils funtions under `transformers_utils` (#29891) · 63b1da76
  Isotr0py authored Dec 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  63b1da76
- [responsesAPI][3] ResponsesParser to set up non harmony MCP (#29413) · 52cb349f
  Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  52cb349f
- [Bugfix] Fix incorrect channel order for idefics3 in edge case (#29881) · 0ec84221
  Isotr0py authored Dec 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0ec84221
- [examples] Resettle pooling examples. (#29365) · 2eb4fe91
  wang.yuqi authored Dec 02, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2eb4fe91
- [Bugfix] Fix DeepSeek R1 MTP weight loading (#29545) · 51c57b51
  Matthew Bonanni authored Dec 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  51c57b51
- [Multimodal][Core] Optimize multimodal preprocessing cache by hashing image... · 60c3d413
  ImaGoodFella authored Dec 02, 2025
```
[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image bytes instead of pixel values (#29621)
Signed-off-by: Rahul Steiger <rasteiger@ethz.ch>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  60c3d413
- [Chore] Use `tokenizer.encode` and `tokenizer.decode` directly (#29851) · 68ffbca7
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68ffbca7
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
- Add Mistral Large 3 and Ministral 3 (#29757) · d8c6210e
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>
```
  d8c6210e
- [vLLM Benchmark Suite] Add default parameters section and update CPU benchmark cases (#29381) · 8bbcf8b6
  Louie Tsai authored Dec 02, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
```
  8bbcf8b6
- [BugFix] add max-num-batched-token to scheduler hash (#29829) · 70fb77b4
  Boyuan Feng authored Dec 02, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  70fb77b4
- [CI] Fix Bad_words test for tokenizer encode/decode asymmetry (#28193) · 48d15a32
  杰兮 authored Dec 02, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
  48d15a32
- [BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761) · 3b221cb6
  Boyuan Feng authored Dec 01, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  3b221cb6
- [Core] Eliminate redundant is_encoder_decoder lookups (20-40us/step) (#29800) · 0037b574
  Wushi Dong authored Dec 01, 2025
```
Signed-off-by: Wushi Dong <dongws@meta.com>
```
  0037b574
- Fix some Transformers nightly tests (#29802) · f5b0846b
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f5b0846b
- [CPU]Parallelize over tokens in int4 moe (#29600) · 13ea39bc
  Zhang Xiangze authored Dec 02, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  13ea39bc
- [CI] Renovation of nightly wheel build & generation (take 2) (#29838) · 4b612664
  Shengqi Chen authored Dec 02, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  4b612664
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
- [CI][AMD] spec_decode:eagle skip FLASH_ATTN for deepseek on ROCm (#29827) · e2fbfc95
  Divakar Verma authored Dec 01, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  e2fbfc95
- [CI][ROCm] Fix test_correctness_sliding_window (#29243) · a690fb5b
  Divakar Verma authored Dec 01, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a690fb5b
- [BugFix] Fix index error in ngram_proposer (#29779) · 81fe3f82
  usberkeley authored Dec 02, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  81fe3f82
- [Misc] Update conftest for entrypoints/sagemaker test folder (#29799) · 53bf71b0
  Zuyi Zhao authored Dec 01, 2025
```
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
```
  53bf71b0
- Add missing return in _check_vllm_model_embed_input_ids (#29834) · f441d36c
  Johnny Yang authored Dec 01, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  f441d36c
- [Misc] Add ReplicaId to Ray metrics (#24267) · 22274b21
  Seiji Eicher authored Dec 01, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Co-authored-by: rongfu.leng <1275177125@qq.com>
```
  22274b21
- [Misc] Throw error on unintended access to scheduler_config.max_model_len (#29771) · fc95521b
  Wei Wei authored Dec 01, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  fc95521b
- [Core] Support reseting all running requests' KV while calling `reset_prefix_cache` (#28827) · d0cd7289
  Zhuohan Li authored Dec 01, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  d0cd7289
- [responsesAPI][4] fix responseOutputItem Kimi K2 thinking bug (#29555) · fa8804ad
  Andrew Xia authored Dec 01, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  fa8804ad
- [ROCm] Fallback pytorch GELU with tanh approximation to GELU() (#29244) · 4b409249
  Divakar Verma authored Dec 01, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Signed-off-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  4b409249
- SM120 / NVFP4: add device guard and runtime SM dispatch to cutlass_scaled_fp4_mm (#29711) · c0dfc894
  Hendrik Holtmann authored Dec 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  c0dfc894
- [BugFix] Preserve spec decoding uniform decode when scheduling (#29759) · 44822d7f
  Nick Hill authored Dec 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  44822d7f
01 Dec, 2025 4 commits
- Updated CI mirror 2025-11-25 (#29434) · 342c4f14
  Alexei-V-Ivanov-AMD authored Dec 01, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Signed-off-by: Alexei-V-Ivanov-AMD <156011006+Alexei-V-Ivanov-AMD@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
  342c4f14
- Revert #29787 and #29690 (#29815) · 1336a1ea
  Kevin H. Luu authored Dec 01, 2025
  
  1336a1ea
- [Ascend]: Fixed the issue where OOT Platform vllm-ascend could not enable SP in Eager mode (#28935) · eaf81485
  Nengjun Ma authored Dec 02, 2025
```
Signed-off-by: leo-pony <nengjunma@outlook.com>
```
  eaf81485
- Update FAQ on interleaving sliding windows support (#29796) · 38caf7fa
  Finbarr Timbers authored Dec 01, 2025
```
Signed-off-by: Finbarr Timbers <finbarrtimbers@gmail.com>
```
  38caf7fa