Commits · a99300bda69edba0082a9038143ecd66de4d078b · OpenDAS / vllm_cscc

29 Aug, 2025 1 commit

[V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b

Maximilien de Bayser authored Aug 29, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2554b27b

15 Aug, 2025 1 commit
- [V0 Deprecation] Remove advance_step (#22969) · 1c859a13
  Woosuk Kwon authored Aug 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1c859a13
13 Aug, 2025 1 commit

[V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6

Woosuk Kwon authored Aug 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>

71683ca6

29 Jul, 2025 1 commit
- [Bugfix] VLLM_V1 supports passing other compilation levels (#19340) · 04e38500
  Richard Zou authored Jul 29, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  04e38500
24 Jul, 2025 1 commit
- [BugFix]: Batch generation from prompt_embeds fails for long prompts (#21390) · fd48d99f
  KazusatoOoko authored Jul 23, 2025
```
Signed-off-by: KazusatoOko <kazusto.oko@sakana.ai>
Co-authored-by: KazusatoOko <kazusto.oko@sakana.ai>
```
  fd48d99f
23 Jul, 2025 1 commit
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
12 Jul, 2025 2 commits
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
- [Misc] Respect `no_use_tqdm_on_load` flag while capturing CUDA graph (#20834) · f56d2996
  lkchen authored Jul 11, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  f56d2996
10 Jul, 2025 1 commit
- add two batch overlap decude support muti-stream cuda-graph · fe1c4016
  zhuwenwen authored Jul 10, 2025
  
  fe1c4016
08 Jul, 2025 1 commit

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e

Sanger Steel authored Jul 08, 2025


[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>

72d14d0e

04 Jun, 2025 1 commit
- [Core] Cast multimodal input in hf processor (#18862) · 1409ef91
  Lukas Geiger authored Jun 04, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  1409ef91
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
27 May, 2025 1 commit
- [Core] Automatically cast multi-modal input dtype (#18756) · 696259ca
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  696259ca
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
22 May, 2025 1 commit

[Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18526) · f6037d19

燃 authored May 22, 2025


Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

f6037d19

21 May, 2025 1 commit
- Revert "[Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407)" (#18456) · ad0012a0
  Cyrus Leung authored May 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad0012a0
20 May, 2025 2 commits
- [Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407) · be48360c
  燃 authored May 20, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
```
  be48360c
- [Core] [Bugfix]: tensor parallel with prompt embeds (#18171) · 9609327f
  Nan Qin authored May 19, 2025
```
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
```
  9609327f
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929
13 May, 2025 1 commit
- Implements dual-chunk-flash-attn backend for dual chunk attention with sparse... · 60f76243
  Tao He authored May 13, 2025
```
Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
```
  60f76243
09 May, 2025 6 commits
- roll back unused change · 29e922ac
  lizhigong authored May 09, 2025
  
  29e922ac
- rm debug log · 7d224eb2
  lizhigong authored May 08, 2025
  
  7d224eb2
- debug spec decode zero overhead · 0ecda6d1
  lizhigong authored May 08, 2025
  
  0ecda6d1
- add spec decode zero overhead · 01c30741
  lizhigong authored Apr 27, 2025
  
  01c30741
- debug v0 zero overhead schedule · 4ff58b66
  lizhigong authored Apr 14, 2025
  
  4ff58b66
- add v0 zero overhead · 54294854
  lizhigong authored Apr 11, 2025
  
  54294854
07 May, 2025 2 commits
- [fix]修复cudagraph和eager分段模式开启mla后报错问题 · 91c7bda5
  zhuwenwen authored May 07, 2025
  
  91c7bda5
- [Misc] Split model loader (#17712) · 822de7fb
  Jee Jee Li authored May 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  822de7fb
03 May, 2025 1 commit
- [Core] Gate `prompt_embeds` behind a feature flag (#17607) · 887d7af8
  Cyrus Leung authored May 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  887d7af8
02 May, 2025 1 commit

[Core] [Bugfix] Add Input Embeddings (#15428) · cc2a77d7

Andrew Sansom authored May 02, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

cc2a77d7

28 Apr, 2025 1 commit
- [Core] Remove legacy input mapper/processor from V0 (#15686) · aec9674d
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aec9674d
25 Apr, 2025 1 commit
- Use Transformers helper `get_text_config()` instead of checking for `text_config` (#17105) · 423e9f1c
  Harry Mellor authored Apr 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  423e9f1c
24 Apr, 2025 1 commit
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
19 Apr, 2025 1 commit

[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) · 2c1bd848

Yang Fan authored Apr 19, 2025


Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>

2c1bd848

17 Apr, 2025 1 commit

[P/D][V1] KV Connector API V1 (#15960) · 3408e471

Yihua Cheng authored Apr 17, 2025


Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>

3408e471

14 Apr, 2025 1 commit
- remove unused code · 641fc5b7
  zhuwenwen authored Apr 14, 2025
  
  641fc5b7
10 Apr, 2025 1 commit
- [misc] use tqdm.auto where appropriate (#16290) · 82eb61dd
  Benjamin Kitor authored Apr 09, 2025
```
Signed-off-by: Benjamin Kitor <bkitor@gigaio.com>
```
  82eb61dd
31 Mar, 2025 1 commit
- fix: change GB to GiB in logging close #14979 (#15807) · 2de41182
  yihong authored Apr 01, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2de41182
26 Mar, 2025 1 commit

[misc] LoRA - Skip LoRA kernels when not required (#15152) · 6c663dfd

Varun Sundar Rabindranath authored Mar 25, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

6c663dfd

16 Mar, 2025 1 commit
- Revert "[Bugfix] Limit profiling run sequence length by max_model_len (#14785) (#14892) · f6137adb
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6137adb