Commits · bbfb55c29e7febb91e90f261dd9adb4200ee3a09 · OpenDAS / vllm_cscc · GitLab

03 Dec, 2025 7 commits
- [Misc] Allow `fetch_*` utils to access local files by default (#29932) · bbfb55c2
  Cyrus Leung authored Dec 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bbfb55c2
- [BugFix] fix imgs_pos in hunyuan_vl (#29879) · 0bec63fa
  JackieWu authored Dec 03, 2025
```
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0bec63fa
- [Bugfix] Defunctionalize TRTLLM AR+Norm op for avoiding extra clone kernel before it (#29631) · c719c405
  elvischenv authored Dec 03, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  c719c405
- [Docs] Discuss api key limitations in security guide (#29922) · b08025a8
  Russell Bryant authored Dec 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b08025a8
- [Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26
  Arpit Khandelwal authored Dec 02, 2025
```
Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  d7284a26
- [Bugfix] Fix regression on pooling models from PR#29621 (#29921) · 4dd79783
  Roger Wang authored Dec 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  4dd79783
- [BugFix] Fix assert in `build_for_cudagraph_capture` (#29893) · 5cdd6645
  Lucas Wilkinson authored Dec 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5cdd6645
02 Dec, 2025 32 commits
- [Doc] Add allocate_slots parameter docs (#29777) · 5d91d2b2
  maang-h authored Dec 03, 2025
```
Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  5d91d2b2
- [BUGFIX] Fix regex pattern for Mistral Tool Call (#29918) · 1b1e35aa
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  1b1e35aa
- [BUGFIX] llama_4_scaling wrongly passed to DeepseekAttention (#29908) · 5e5646e2
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5e5646e2
- [Bugfix] fix --scheduling-policy=priority & n>1 crashes engine (#29764) · 0a9caca9
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  0a9caca9
- [Bugfix][EPLB] Prevent user-provided EPLB config from being overwritten with defaults (#29911) · e6f114ac
  Sage Moore authored Dec 02, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  e6f114ac
- Fix some more Transformers nightly tests (#29872) · 6fc5841d
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6fc5841d
- [Perf] Avoid pageable HtoD transfer in MinTokensLogitsProcessor (#29826) · 1528e079
  jthomson04 authored Dec 02, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1528e079
- Fix boolean nested params, add dict format support, and enhance plotting for... · 1c593e11
  Copilot authored Dec 02, 2025
```
Fix boolean nested params, add dict format support, and enhance plotting for vllm bench sweep (#29025)
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  1c593e11
- feat(model): Add BitsAndBytes quantization support for Qwen3-Omni-MoE (#29896) · a2b053dc
  Navanit Dubey authored Dec 03, 2025
```
Signed-off-by: navanit-git <navanitdubey@gmail.com>
```
  a2b053dc
- [Attention][CUDAGraph] Remove CG padding from attention backends (#29352) · 1d93f116
  Matthew Bonanni authored Dec 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  1d93f116
- [Chore]: Reorganize gguf utils funtions under `transformers_utils` (#29891) · 63b1da76
  Isotr0py authored Dec 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  63b1da76
- [responsesAPI][3] ResponsesParser to set up non harmony MCP (#29413) · 52cb349f
  Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  52cb349f
- [Bugfix] Fix incorrect channel order for idefics3 in edge case (#29881) · 0ec84221
  Isotr0py authored Dec 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0ec84221
- [Bugfix] Fix DeepSeek R1 MTP weight loading (#29545) · 51c57b51
  Matthew Bonanni authored Dec 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  51c57b51
- [Multimodal][Core] Optimize multimodal preprocessing cache by hashing image... · 60c3d413
  ImaGoodFella authored Dec 02, 2025
```
[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image bytes instead of pixel values (#29621)
Signed-off-by: Rahul Steiger <rasteiger@ethz.ch>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  60c3d413
- [Chore] Use `tokenizer.encode` and `tokenizer.decode` directly (#29851) · 68ffbca7
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68ffbca7
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
- Add Mistral Large 3 and Ministral 3 (#29757) · d8c6210e
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>
```
  d8c6210e
- [BugFix] add max-num-batched-token to scheduler hash (#29829) · 70fb77b4
  Boyuan Feng authored Dec 02, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  70fb77b4
- [BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761) · 3b221cb6
  Boyuan Feng authored Dec 01, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  3b221cb6
- [Core] Eliminate redundant is_encoder_decoder lookups (20-40us/step) (#29800) · 0037b574
  Wushi Dong authored Dec 01, 2025
```
Signed-off-by: Wushi Dong <dongws@meta.com>
```
  0037b574
- Fix some Transformers nightly tests (#29802) · f5b0846b
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f5b0846b
- [CI] Renovation of nightly wheel build & generation (take 2) (#29838) · 4b612664
  Shengqi Chen authored Dec 02, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  4b612664
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
- [BugFix] Fix index error in ngram_proposer (#29779) · 81fe3f82
  usberkeley authored Dec 02, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  81fe3f82
- Add missing return in _check_vllm_model_embed_input_ids (#29834) · f441d36c
  Johnny Yang authored Dec 01, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  f441d36c
- [Misc] Add ReplicaId to Ray metrics (#24267) · 22274b21
  Seiji Eicher authored Dec 01, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Co-authored-by: rongfu.leng <1275177125@qq.com>
```
  22274b21
- [Misc] Throw error on unintended access to scheduler_config.max_model_len (#29771) · fc95521b
  Wei Wei authored Dec 01, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  fc95521b
- [Core] Support reseting all running requests' KV while calling `reset_prefix_cache` (#28827) · d0cd7289
  Zhuohan Li authored Dec 01, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  d0cd7289
- [responsesAPI][4] fix responseOutputItem Kimi K2 thinking bug (#29555) · fa8804ad
  Andrew Xia authored Dec 01, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  fa8804ad
- [ROCm] Fallback pytorch GELU with tanh approximation to GELU() (#29244) · 4b409249
  Divakar Verma authored Dec 01, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Signed-off-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  4b409249
- [BugFix] Preserve spec decoding uniform decode when scheduling (#29759) · 44822d7f
  Nick Hill authored Dec 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  44822d7f
01 Dec, 2025 1 commit
- Revert #29787 and #29690 (#29815) · 1336a1ea
  Kevin H. Luu authored Dec 01, 2025
  
  1336a1ea