Commits · 77a29416468379a8c36eb591bfe7d262ddc4ceca · OpenDAS / vllm_cscc

06 Aug, 2025 1 commit
- update VLLM_FLASH_ATTN_V1 to VLLM_USE_FLASH_ATTN_PA · 77a29416
  zhuwenwen authored Aug 06, 2025
  
  77a29416
05 Aug, 2025 1 commit
- when using VLLM_FLASH_ATTN_V1, set block_size to 64 · f54639f9
  zhuwenwen authored Aug 05, 2025
  
  f54639f9
01 Aug, 2025 2 commits
- set default block_size to 16 · d8a060dd
  zhuwenwen authored Aug 01, 2025
  
  d8a060dd
- [feat]支持v1 engine mtp cudagraph · 00e13357
  zhuwenwen authored Aug 01, 2025
  
  00e13357
29 Jul, 2025 1 commit
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
25 Jul, 2025 1 commit
- [Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all... · b35835a1
  zhuwenwen authored Jul 25, 2025
```
[Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all cudagraph capture sizes <= max_num_seq.
```
  b35835a1
24 Jul, 2025 1 commit

[DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8

Robert Shaw authored Jul 23, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

d5b981f8

23 Jul, 2025 3 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
22 Jul, 2025 4 commits
- [BugFix] Fix ray import error mem cleanup bug (#21381) · b77c7d32
  Joe Runde authored Jul 22, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  b77c7d32
- update max_seq_len_to_capture to option int · d560429c
  zhuwenwen authored Jul 22, 2025
  
  d560429c
- update max_seq_len_to_capture to int · 988fc31c
  zhuwenwen authored Jul 22, 2025
  
  988fc31c
- [Feature][eplb] add verify ep or tp or dp (#21102) · 3779eb8c
  rongfu.leng authored Jul 22, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  3779eb8c
21 Jul, 2025 3 commits
- Add Nvidia ModelOpt config adaptation (#19815) · 6b46c4b6
  Zhiyu authored Jul 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  6b46c4b6
- update max_seq_len_to_capture · 72273242
  zhuwenwen authored Jul 21, 2025
  
  72273242
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
20 Jul, 2025 1 commit

[Model] Support VLMs with transformers backend (#20543) · 9499e26e

Raushan Turganbay authored Jul 20, 2025


Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9499e26e

19 Jul, 2025 6 commits

GLM-4 Update (#20736) · 10eb24cc

Yuxuan Zhang authored Jul 20, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>

10eb24cc

[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
881e3cbe
[V0 deprecation] Remove long context LoRA (#21169) · 1eaff278
Jee Jee Li authored Jul 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1eaff278
[V0 Deprecation] Remove V0 Spec Decode workers (#21152) · dd572c0a
Woosuk Kwon authored Jul 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
dd572c0a

[Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14

Lucia Fang authored Jul 19, 2025


Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>

9a9fda14

Elastic Expert Parallel Initial Support (#20775) · 21793722
Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
21793722

18 Jul, 2025 1 commit
- [Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103) · ca4eb82b
  wang.yuqi authored Jul 18, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  ca4eb82b
17 Jul, 2025 3 commits
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
- update adpaptive block_size · 937a3ec1
  zhuwenwen authored Jul 17, 2025
  
  937a3ec1
- update default block_size · 4a84480f
  zhuwenwen authored Jul 17, 2025
  
  4a84480f
16 Jul, 2025 1 commit

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC... · 01513a33

Nir David authored Jul 16, 2025


Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>

01513a33

15 Jul, 2025 4 commits
- [Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) · 313ae8c1
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  313ae8c1
- [Deprecation] Remove `TokenizerPoolConfig` (#20968) · 56fe4bed
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  56fe4bed
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
- Implement Async Scheduling (#19970) · d4d30940
  Woosuk Kwon authored Jul 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d4d30940
14 Jul, 2025 3 commits
- Change default model to Qwen3-0.6B (#20335) · 55975621
  Tyler Michael Smith authored Jul 14, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  55975621
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
13 Jul, 2025 2 commits

[Bugfix] Fix: add patch_rope_scaling after hf override (#20857) · 247102f0
Wang Siyuan authored Jul 13, 2025
```
Signed-off-by: Wang Siyuan <wsy0227@sjtu.edu.cn>
Signed-off-by: Wang Siyuan <sywang0227@gmail.com>
```
247102f0

[Core] Support multiple tasks per model (#20771) · 020f58ab

Nicolò Lucchesi authored Jul 13, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

020f58ab

12 Jul, 2025 2 commits
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d