Commits · 3e330fcb218e207bbc9eec3ed479a8b53b25c98d · OpenDAS / vllm_cscc

01 Sep, 2025 17 commits
- [Doc]: Fix CPU install docs: force torch-backend=cpu to avoid GPU torchvision errors (#24033) · 3e330fcb
  Kay Yan authored Sep 01, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  3e330fcb
- [Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735) · d46934b2
  Nicolò Lucchesi authored Sep 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d46934b2
- [Doc]: fix typos in Python comments (#24026) · 10728495
  Didier Durand authored Sep 01, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  10728495
- [Kernel] Update DeepGEMM to latest commit (#23915) · dc1a5318
  Jee Jee Li authored Sep 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  dc1a5318
- [Frontend] Update the warning log when using VLLM_ALLOW_LONG_MAX_MODEL_LEN (#20904) · 55602bb2
  wang.yuqi authored Sep 01, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  55602bb2
- [Misc] Enable V1 FP16 inference on pre-Ampere GPUs (#24022) · d7fbc6dd
  Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d7fbc6dd
- [Misc] add hash_function doc string (#24014) · 5438967f
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5438967f
- [Bugfix] Add support for `<tool_call>` format in streaming mode for XLAM Tool Parser (#22769) · 422e793f
  Code Jesus authored Aug 31, 2025
```
Signed-off-by: Devon Peroutky <devon@kindo.ai>
```
  422e793f
- [Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  1cb39dbc
- Migrate Phi4 inputs to TensorSchema (#23471) · 437c3ce0
  Benji Beck authored Aug 31, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  437c3ce0
- [Misc] refactor code by import as for torch._inductor.config (#23677) · 499b074b
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  499b074b
- [CI/Build] Improve Tensor Schema tests speed by avoid engine core initialization (#23357) · ff0e59d8
  Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ff0e59d8
- [Misc] Move fast prefill logic to separate method (#24013) · b5571368
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5571368
- Fix the bug related to loading GPTP INT3 weights. (#23328) · acc1a6e1
  Jun-Howie authored Sep 01, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  acc1a6e1
- [Misc] Avoid redundant copy for encoder-only models (#24012) · 8c742a66
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8c742a66
- [BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and... · 183a7096
  JartX authored Sep 01, 2025
```
[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and AutoRound-GPTQ) (#23994)
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  183a7096
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
31 Aug, 2025 4 commits
- [Minor] Fix some random typos in comments (#24009) · 752d2e1c
  Nick Hill authored Aug 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  752d2e1c
- vllm fix check on max vocab size (#22471) · 81eea3d3
  Xiaodong Wang authored Aug 31, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  81eea3d3
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
30 Aug, 2025 15 commits

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

[LoRA] Much faster startup when LoRA is enabled (#23777) · 038e9be4
Andy Lo authored Aug 30, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
038e9be4
[Misc] enhance type hint for rearrange return value (#23519) · 68a34911
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
68a34911
[Refactor] refactor freezing_value/cuda_event initialize outside try finally (#23758) · e80bca30
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
e80bca30
[Misc] add reorder_batch AttentionMetadataBuilder (#23798) · fb4983e1
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
fb4983e1

Add LoRA support for DeepSeek models (V2, V3, R1-0528) (#23971) · 379ea282

sadegh.shokatian authored Aug 30, 2025


Signed-off-by: sadeghja1070 <sadegh.ja1070@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

379ea282

[Model] Enable encoder DP for MiniCPM-V (#23948) · 3a6acad4

Jiangyun Zhu authored Aug 30, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

3a6acad4

[UT] fix unify_kv_cache_configs when kv cache config needs sort (#23843) · 5490d633
Ning Xie authored Aug 30, 2025

5490d633
[Bugfix] Fix test_lora_resolvers.py (#23984) · 628d00cd
Jee Jee Li authored Aug 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
628d00cd
[V1] [Hybrid] Move MiniMaxLinearAttention into layers/mamba (#23831) · 4071c76c
Thomas Parnell authored Aug 30, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
4071c76c
[Core] Cleanup TPU model runner for MM (#23894) · f1bddbd8
Cyrus Leung authored Aug 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
f1bddbd8
[CI] Fix broken compile tests due to unsupported SiluMul+Nvfp4Quant fusion (#23973) · 9748c519
Yong Hoon Shin authored Aug 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
9748c519
[CI] Move testing image from remote URL to S3 (#23980) · ee52a327
Roger Wang authored Aug 29, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
ee52a327

Add routed_scaling_factor to MoE grouped topk (#23123) · 8fb85b7b

Xin Yang authored Aug 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8fb85b7b

[Bugfix] Fix --config arg expansion called from api_server.py (#23944) · 5b31cb17

dubejf authored Aug 30, 2025


Signed-off-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

5b31cb17

29 Aug, 2025 4 commits
- [CI] Fix unavailable image remote URL (#23966) · d660c98c
  Roger Wang authored Aug 29, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d660c98c
- [Misc] Make `download_weights_from_hf` more reliable (#23863) · 5674a403
  Harry Mellor authored Aug 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5674a403
- Revert gemma3n fast prefill changes (#23897) · 8c3e1999
  Yong Hoon Shin authored Aug 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8c3e1999
- [Docs] [V1] [Hybrid] Add new documentation re: contributing mamba-based models (#23824) · 1c26b422
  Thomas Parnell authored Aug 29, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  1c26b422