Commits · 81eea3d348c26fb1e6ff0185ad109aedd60a28a2 · OpenDAS / vllm_cscc

31 Aug, 2025 3 commits
- vllm fix check on max vocab size (#22471) · 81eea3d3
  Xiaodong Wang authored Aug 31, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  81eea3d3
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
30 Aug, 2025 15 commits

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

[LoRA] Much faster startup when LoRA is enabled (#23777) · 038e9be4
Andy Lo authored Aug 30, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
038e9be4
[Misc] enhance type hint for rearrange return value (#23519) · 68a34911
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
68a34911
[Refactor] refactor freezing_value/cuda_event initialize outside try finally (#23758) · e80bca30
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
e80bca30
[Misc] add reorder_batch AttentionMetadataBuilder (#23798) · fb4983e1
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
fb4983e1

Add LoRA support for DeepSeek models (V2, V3, R1-0528) (#23971) · 379ea282

sadegh.shokatian authored Aug 30, 2025


Signed-off-by: sadeghja1070 <sadegh.ja1070@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

379ea282

[Model] Enable encoder DP for MiniCPM-V (#23948) · 3a6acad4

Jiangyun Zhu authored Aug 30, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

3a6acad4

[UT] fix unify_kv_cache_configs when kv cache config needs sort (#23843) · 5490d633
Ning Xie authored Aug 30, 2025

5490d633
[Bugfix] Fix test_lora_resolvers.py (#23984) · 628d00cd
Jee Jee Li authored Aug 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
628d00cd
[V1] [Hybrid] Move MiniMaxLinearAttention into layers/mamba (#23831) · 4071c76c
Thomas Parnell authored Aug 30, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
4071c76c
[Core] Cleanup TPU model runner for MM (#23894) · f1bddbd8
Cyrus Leung authored Aug 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
f1bddbd8
[CI] Fix broken compile tests due to unsupported SiluMul+Nvfp4Quant fusion (#23973) · 9748c519
Yong Hoon Shin authored Aug 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
9748c519
[CI] Move testing image from remote URL to S3 (#23980) · ee52a327
Roger Wang authored Aug 29, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
ee52a327

Add routed_scaling_factor to MoE grouped topk (#23123) · 8fb85b7b

Xin Yang authored Aug 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8fb85b7b

[Bugfix] Fix --config arg expansion called from api_server.py (#23944) · 5b31cb17

dubejf authored Aug 30, 2025


Signed-off-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

5b31cb17

29 Aug, 2025 22 commits
- [CI] Fix unavailable image remote URL (#23966) · d660c98c
  Roger Wang authored Aug 29, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d660c98c
- [Misc] Make `download_weights_from_hf` more reliable (#23863) · 5674a403
  Harry Mellor authored Aug 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5674a403
- Revert gemma3n fast prefill changes (#23897) · 8c3e1999
  Yong Hoon Shin authored Aug 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8c3e1999
- [Docs] [V1] [Hybrid] Add new documentation re: contributing mamba-based models (#23824) · 1c26b422
  Thomas Parnell authored Aug 29, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  1c26b422
- Tuned H100/H200 triton fp8 block configs for fused_qkv_a_proj (#23939) · b7adf94c
  Michael Goin authored Aug 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b7adf94c
- [RL][BugFix] Fix missing tokenizer error for token-in-token-out (#23904) · 4d7fe40f
  22quinn authored Aug 29, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4d7fe40f
- [BUGFIX ] fix undefined silu_and_mul_nvfp4_quant (#23929) · 0dc95320
  yzds authored Aug 30, 2025
```
Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: Richard Zou <zou3519@users.noreply.github.com>
```
  0dc95320
- [CI] Add `aiter` to matching list of issue auto labeller for `rocm` tag (#23942) · 72a69132
  vllmellm authored Aug 29, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  72a69132
- [BugFix] Async scheduling and PP compatibility with DP (#23770) · d90d8eb6
  Nick Hill authored Aug 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d90d8eb6
- [Models] Use in-place adds in Idefics2Vision (#23932) · 0a2f4c07
  Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0a2f4c07
- [MODEL] `Apertus` and `XIELU` (#23068) · 1cf3753b
  EduardDurech authored Aug 29, 2025
```
Signed-off-by: EduardDurech <39579228+EduardDurech@users.noreply.github.com>
Co-authored-by: AllenHaoHuang <allenhuangdd@gmail.com>
```
  1cf3753b
- Adds `json_count_leaves` utility function (#23899) · 4f7cde72
  Adit Chawdhary authored Aug 29, 2025
```
Signed-off-by: aditchawdhary <aditxy@hotmail.com>
```
  4f7cde72
- Update PyTorch to 2.8.0 (#20358) · 67c14906
  Huy Do authored Aug 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  67c14906
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
- [Performance] V1 Classify Models E2E Performance Optimization (#23541) · d9e00dbd
  wang.yuqi authored Aug 29, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d9e00dbd
- [CPU] Enable data parallel for CPU backend (#23903) · ad39106b
  Li, Jiang authored Aug 29, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  ad39106b
- [V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b
  Maximilien de Bayser authored Aug 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2554b27b
- Better errors for Transformers backend missing features (#23759) · 934bebf1
  Harry Mellor authored Aug 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  934bebf1
- [Misc] Fix warnings for mistral model (#23552) · 885ca6d3
  Jiangyun Zhu authored Aug 29, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  885ca6d3
- [mrope][Qwen2-VL] Fix edge case where getting index of image/video token can... · 2d0afcc9
  Chenheli Hua authored Aug 28, 2025
```
[mrope][Qwen2-VL] Fix edge case where getting index of image/video token can potentially throw in default vl mrope implementation.  (#23895)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  2d0afcc9
- [CI/Build] Clean up LoRA test (#23890) · b4f9e963
  Jee Jee Li authored Aug 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b4f9e963
- Fix(async): Add support for truncate_prompt_tokens in AsyncLLM (#23800) · 05d839c1
  Raghavan authored Aug 29, 2025
  
  05d839c1