Commits · 5f09420de9c6c493ccfbcb0865e825e76f12cc8b · OpenDAS / vllm_cscc

10 Sep, 2025 4 commits
- update the conditions for pad_v · 5f09420d
  zhuwenwen authored Sep 10, 2025
  
  5f09420d
- update setup.py · e005bce5
  zhuwenwen authored Sep 10, 2025
  
  e005bce5
- update flash-attn interface of apply_rotary_emb · 6c0a30bc
  zhuwenwen authored Sep 10, 2025
  
  6c0a30bc
- add VLLM_USE_TRITON_CAT to opt torch cat · b0dfa004
  zhuwenwen authored Sep 10, 2025
  
  b0dfa004
09 Sep, 2025 1 commit
- Merge tag 'v0.10.2rc1' into v0.10.2rc1-dev · a99300bd
  zhuwenwen authored Sep 09, 2025
  
  a99300bd
07 Sep, 2025 4 commits
- [P/D][Feature]显存调度优化，及时释放tensor · cc3e01c7
  zhuwenwen authored Sep 07, 2025
  
  cc3e01c7
- [fix]fix tests of neuron, quantization etc · 82e6b864
  zhuwenwen authored Sep 07, 2025
  
  82e6b864
- fix precision issue in mtp · 9ebe3034
  zhuwenwen authored Sep 07, 2025
  
  9ebe3034
- 增加reduce修改 · 3cec42d1
  zhuwenwen authored Sep 07, 2025
  
  3cec42d1
06 Sep, 2025 4 commits
- [fix]fix tests of core, samplers and tokenization etc. · 1825007b
  zhuwenwen authored Sep 06, 2025
  
  1825007b
- fix performance issues caused by enabling TBO · 5692ab61
  zhuwenwen authored Sep 06, 2025
  
  5692ab61
- fix bugs in zero overhead and tbo · 533c4cbf
  zhuwenwen authored Sep 06, 2025
  
  533c4cbf
- 暂时去掉profilling标志位，避免影响其他模型 · f42ed372
  zhuwenwen authored Sep 06, 2025
  
  f42ed372
04 Sep, 2025 2 commits
- add glm-4.5-air-tp8 nn moe configs · 81301303
  zhuwenwen authored Sep 04, 2025
  
  81301303
- [fix]fix tests of async_engine and compile · 9531829c
  zhuwenwen authored Sep 04, 2025
  
  9531829c
03 Sep, 2025 2 commits
- [fix]fix tests of v1 and worker · b2d58051
  zhuwenwen authored Sep 03, 2025
  
  b2d58051
- fix deepseek pp + mtp issue · bfd0c5b8
  zhuwenwen authored Sep 03, 2025
  
  bfd0c5b8
02 Sep, 2025 1 commit
- [fix]fix tests of kernels · af7b564d
  zhuwenwen authored Sep 02, 2025
  
  af7b564d
01 Sep, 2025 12 commits
- [Misc] add hash_function doc string (#24014) · 5438967f
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5438967f
- [Bugfix] Add support for `<tool_call>` format in streaming mode for XLAM Tool Parser (#22769) · 422e793f
  Code Jesus authored Aug 31, 2025
```
Signed-off-by: Devon Peroutky <devon@kindo.ai>
```
  422e793f
- [Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  1cb39dbc
- Migrate Phi4 inputs to TensorSchema (#23471) · 437c3ce0
  Benji Beck authored Aug 31, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  437c3ce0
- [Misc] refactor code by import as for torch._inductor.config (#23677) · 499b074b
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  499b074b
- [CI/Build] Improve Tensor Schema tests speed by avoid engine core initialization (#23357) · ff0e59d8
  Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ff0e59d8
- [Misc] Move fast prefill logic to separate method (#24013) · b5571368
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5571368
- Fix the bug related to loading GPTP INT3 weights. (#23328) · acc1a6e1
  Jun-Howie authored Sep 01, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  acc1a6e1
- [Misc] Avoid redundant copy for encoder-only models (#24012) · 8c742a66
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8c742a66
- [BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and... · 183a7096
  JartX authored Sep 01, 2025
```
[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and AutoRound-GPTQ) (#23994)
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  183a7096
- add dca and sparse attention support on rocm · 1faa2c78
  zhuwenwen authored Sep 01, 2025
  
  1faa2c78
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
31 Aug, 2025 4 commits
- [Minor] Fix some random typos in comments (#24009) · 752d2e1c
  Nick Hill authored Aug 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  752d2e1c
- vllm fix check on max vocab size (#22471) · 81eea3d3
  Xiaodong Wang authored Aug 31, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  81eea3d3
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
30 Aug, 2025 6 commits

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

[LoRA] Much faster startup when LoRA is enabled (#23777) · 038e9be4
Andy Lo authored Aug 30, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
038e9be4
[Misc] enhance type hint for rearrange return value (#23519) · 68a34911
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
68a34911
[Refactor] refactor freezing_value/cuda_event initialize outside try finally (#23758) · e80bca30
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
e80bca30
[Misc] add reorder_batch AttentionMetadataBuilder (#23798) · fb4983e1
Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
fb4983e1

Add LoRA support for DeepSeek models (V2, V3, R1-0528) (#23971) · 379ea282

sadegh.shokatian authored Aug 30, 2025


Signed-off-by: sadeghja1070 <sadegh.ja1070@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

379ea282