Commits · 20316346808ada97d6b1bfe86cd5e6b5fe804bcd · OpenDAS / vllm_cscc

19 Aug, 2025 1 commit
- update v1 fa layout · 864c718a
  zhuwenwen authored Aug 19, 2025
  
  864c718a
18 Aug, 2025 1 commit
- [fix]解决v1 deepseek cudagraph模式显存占用增长 · 81175fe4
  王敏 authored Aug 18, 2025
  
  81175fe4
16 Aug, 2025 1 commit
- debug and fix erro · 4b4fc875
  lizhigong authored Aug 16, 2025
  
  4b4fc875
15 Aug, 2025 1 commit
- add v1 engine + deepseek r1 mtp + zero-overhead scheduler · 5dcaac2f
  lizhigong authored Aug 15, 2025
  
  5dcaac2f
14 Aug, 2025 1 commit
- remove seq_lens_tensor of v1 fa · 693d5ed4
  zhuwenwen authored Aug 14, 2025
  
  693d5ed4
13 Aug, 2025 2 commits
- add VLLM_USE_PA_PRINT_PARAM to print v1 fa size · 8a1e7a3d
  zhuwenwen authored Aug 13, 2025
  
  8a1e7a3d
- [feat]优化mtp/eagle的计算逻辑，减少第1层并行解码的计算重复 · 619eb032
  王敏 authored Aug 13, 2025
  
  619eb032
11 Aug, 2025 1 commit
- add v1 engine zero overhead · 59e80222
  lizhigong authored Aug 11, 2025
  
  59e80222
08 Aug, 2025 1 commit
- update fa full_cuda_graph support · 513f17a4
  zhuwenwen authored Aug 08, 2025
  
  513f17a4
07 Aug, 2025 2 commits
- [feat]支持mtp模型full_cuda_graph · 89eecc55
  王敏 authored Aug 07, 2025
  
  89eecc55
- [feat]支持mtp模型full_cuda_graph · a1239b53
  王敏 authored Aug 07, 2025
  
  a1239b53
06 Aug, 2025 2 commits
- [feat]支持mtp模型full_cuda_graph · 9dd945c1
  王敏 authored Aug 06, 2025
  
  9dd945c1
- Revert "Merge remote-tracking branch 'origin/v0.9.2-dev-wm' into v0.9.2-dev" · 0c1cd0f5
  zhuwenwen authored Aug 06, 2025
```
This reverts merge request !169
```
  0c1cd0f5
05 Aug, 2025 3 commits
- [feat]优化mtp相关函数返回类型 · 7e71c143
  王敏 authored Aug 05, 2025
  
  7e71c143
- merge and debug tbo on 0.9.2 · 3f8b2afe
  lizhigong authored Aug 05, 2025
  
  3f8b2afe
- [feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样 · 8e0ae19d
  王敏 authored Aug 05, 2025
  
  8e0ae19d
04 Aug, 2025 1 commit
- add tbo on v1 engine · 20e75ed6
  lizhigong authored Aug 02, 2025
  
  20e75ed6
31 Jul, 2025 1 commit
- [feat]支持v1 engine mtp cudagraph · fe393be8
  王敏 authored Jul 31, 2025
  
  fe393be8
24 Jul, 2025 1 commit
- support full_cuda_graph · 8da1c576
  zhuwenwen authored Jul 24, 2025
  
  8da1c576
12 Jul, 2025 1 commit
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
07 Jul, 2025 1 commit
- [feat]支持v1 engine flashmla和mtp同时开启 · ac4dedb1
  王敏 authored Jul 07, 2025
  
  ac4dedb1
06 Jul, 2025 1 commit
- [BugFix][Spec Decode] Fix spec token ids in model runner (#20530) · 9528e3a0
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9528e3a0
04 Jul, 2025 2 commits

Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022

Thomas Parnell authored Jul 04, 2025


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

2f35a022

[Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1caca5a5

02 Jul, 2025 2 commits

[V1] LogitsProcessor programming model (#16728) · 48fb076c

afeldman-nm authored Jul 02, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

48fb076c

[TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
7da296be

01 Jul, 2025 2 commits
- [Optimization] Cache sampled token ids in model runner (#20291) · 7f280d69
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f280d69
- [V1] Only print cudagraph tqdm on rank 0 with `is_global_first_rank` (#19516) · be250bbc
  Michael Goin authored Jul 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  be250bbc
30 Jun, 2025 3 commits
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
- [Spec Decode] Refactor spec decoding into a separate function (#20238) · 2062c072
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2062c072
- [Misc] Fix import (#20233) · 19108ef3
  Woosuk Kwon authored Jun 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  19108ef3
26 Jun, 2025 3 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1
25 Jun, 2025 2 commits
- [TPU] Add TPU specific var VLLM_TPU_MOST_MODEL_LEN (#19919) · 2d7620c3
  Chenyaaang authored Jun 25, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  2d7620c3
- [TPU][Bugfix] fix kv cache padding (#20048) · 2cc20699
  Chengji Yao authored Jun 25, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  2cc20699
24 Jun, 2025 2 commits
- [Bugfix][CPU] Fix InputBatch for pooling models in the CPU v1 (#20014) · 53da4cd3
  Li, Jiang authored Jun 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  53da4cd3
- [PERF] Speedup of MRoPE prepare inputs (#19939) · 9a3b8832
  Vadim Gimpelson authored Jun 24, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  9a3b8832
23 Jun, 2025 1 commit
- [Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956) · 61f4fc5d
  Isotr0py authored Jun 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  61f4fc5d
20 Jun, 2025 1 commit
- Export NaNs in logits to scheduler_stats if output is corrupted (#18777) · 2e3e3c86
  Vlad Tiberiu Mihailescu authored Jun 20, 2025
```
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
```
  2e3e3c86