Commits · 437c3ce02615443ab166f4155028c1d81ee27c06 · OpenDAS / vllm_cscc

"vllm/tool_parsers/hermes_tool_parser.py" did not exist on "d6953beb91da4e9c99be4c0a1304a2d24189535c"

01 Sep, 2025 8 commits
- Migrate Phi4 inputs to TensorSchema (#23471) · 437c3ce0
  Benji Beck authored Aug 31, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  437c3ce0
- [Misc] refactor code by import as for torch._inductor.config (#23677) · 499b074b
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  499b074b
- [CI/Build] Improve Tensor Schema tests speed by avoid engine core initialization (#23357) · ff0e59d8
  Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ff0e59d8
- [Misc] Move fast prefill logic to separate method (#24013) · b5571368
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5571368
- Fix the bug related to loading GPTP INT3 weights. (#23328) · acc1a6e1
  Jun-Howie authored Sep 01, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  acc1a6e1
- [Misc] Avoid redundant copy for encoder-only models (#24012) · 8c742a66
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8c742a66
- [BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and... · 183a7096
  JartX authored Sep 01, 2025
```
[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and AutoRound-GPTQ) (#23994)
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  183a7096
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
31 Aug, 2025 4 commits
- [Minor] Fix some random typos in comments (#24009) · 752d2e1c
  Nick Hill authored Aug 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  752d2e1c
- vllm fix check on max vocab size (#22471) · 81eea3d3
  Xiaodong Wang authored Aug 31, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  81eea3d3
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
30 Aug, 2025 13 commits

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

[LoRA] Much faster startup when LoRA is enabled (#23777) · 038e9be4
Andy Lo authored Aug 30, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
038e9be4
[Misc] enhance type hint for rearrange return value (#23519) · 68a34911
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
68a34911
[Refactor] refactor freezing_value/cuda_event initialize outside try finally (#23758) · e80bca30
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
e80bca30
[Misc] add reorder_batch AttentionMetadataBuilder (#23798) · fb4983e1
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
fb4983e1

Add LoRA support for DeepSeek models (V2, V3, R1-0528) (#23971) · 379ea282

sadegh.shokatian authored Aug 30, 2025


Signed-off-by: sadeghja1070 <sadegh.ja1070@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

379ea282

[Model] Enable encoder DP for MiniCPM-V (#23948) · 3a6acad4

Jiangyun Zhu authored Aug 30, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

3a6acad4

[V1] [Hybrid] Move MiniMaxLinearAttention into layers/mamba (#23831) · 4071c76c
Thomas Parnell authored Aug 30, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
4071c76c
[Core] Cleanup TPU model runner for MM (#23894) · f1bddbd8
Cyrus Leung authored Aug 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
f1bddbd8
[CI] Fix broken compile tests due to unsupported SiluMul+Nvfp4Quant fusion (#23973) · 9748c519
Yong Hoon Shin authored Aug 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
9748c519
[CI] Move testing image from remote URL to S3 (#23980) · ee52a327
Roger Wang authored Aug 29, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
ee52a327

Add routed_scaling_factor to MoE grouped topk (#23123) · 8fb85b7b

Xin Yang authored Aug 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8fb85b7b

[Bugfix] Fix --config arg expansion called from api_server.py (#23944) · 5b31cb17

dubejf authored Aug 30, 2025


Signed-off-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

5b31cb17

29 Aug, 2025 15 commits
- [Misc] Make `download_weights_from_hf` more reliable (#23863) · 5674a403
  Harry Mellor authored Aug 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5674a403
- Revert gemma3n fast prefill changes (#23897) · 8c3e1999
  Yong Hoon Shin authored Aug 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8c3e1999
- Tuned H100/H200 triton fp8 block configs for fused_qkv_a_proj (#23939) · b7adf94c
  Michael Goin authored Aug 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b7adf94c
- [RL][BugFix] Fix missing tokenizer error for token-in-token-out (#23904) · 4d7fe40f
  22quinn authored Aug 29, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4d7fe40f
- [BUGFIX ] fix undefined silu_and_mul_nvfp4_quant (#23929) · 0dc95320
  yzds authored Aug 30, 2025
```
Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: Richard Zou <zou3519@users.noreply.github.com>
```
  0dc95320
- [BugFix] Async scheduling and PP compatibility with DP (#23770) · d90d8eb6
  Nick Hill authored Aug 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d90d8eb6
- [Models] Use in-place adds in Idefics2Vision (#23932) · 0a2f4c07
  Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0a2f4c07
- [MODEL] `Apertus` and `XIELU` (#23068) · 1cf3753b
  EduardDurech authored Aug 29, 2025
```
Signed-off-by: EduardDurech <39579228+EduardDurech@users.noreply.github.com>
Co-authored-by: AllenHaoHuang <allenhuangdd@gmail.com>
```
  1cf3753b
- Adds `json_count_leaves` utility function (#23899) · 4f7cde72
  Adit Chawdhary authored Aug 29, 2025
```
Signed-off-by: aditchawdhary <aditxy@hotmail.com>
```
  4f7cde72
- Update PyTorch to 2.8.0 (#20358) · 67c14906
  Huy Do authored Aug 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  67c14906
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
- [Performance] V1 Classify Models E2E Performance Optimization (#23541) · d9e00dbd
  wang.yuqi authored Aug 29, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d9e00dbd
- [CPU] Enable data parallel for CPU backend (#23903) · ad39106b
  Li, Jiang authored Aug 29, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  ad39106b
- [V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b
  Maximilien de Bayser authored Aug 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2554b27b
- Better errors for Transformers backend missing features (#23759) · 934bebf1
  Harry Mellor authored Aug 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  934bebf1