Commits · 80e9afb5bc53a5ca9f2b229e46c3cdead2704f5c · OpenDAS / vllm_cscc

07 Mar, 2025 1 commit

[V1][Core] Support for Structured Outputs (#12388) · 80e9afb5

Aaron Pham authored Mar 07, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

80e9afb5

06 Mar, 2025 2 commits
- [Hardware][TPU]Enable ragged paged attention kernel and resolve recompilation issue (#14310) · 0578e5a4
  Chengji Yao authored Mar 06, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  0578e5a4
- [BugFix] MLA + V1, illegal memory access and accuracy issues (#14253) · f6bb18fd
  Lucas Wilkinson authored Mar 05, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  f6bb18fd
05 Mar, 2025 6 commits
- [V1][BugFix] Fix for mixed top_k batch (#14301) · ac60dc7f
  Nick Hill authored Mar 05, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Ye Cao <caoye.cao@alibaba-inc.com>
```
  ac60dc7f
- [V1][Minor] Remove obsolete FIXME comment (#14304) · a32c8669
  Nick Hill authored Mar 05, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  a32c8669
- [V1][Frontend] Add Testing For V1 Runtime Parameters (#14159) · 257e200a
  Robert Shaw authored Mar 05, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  257e200a
- [Bugfix][V1] Fix allowed_token_ids for v1 Sampler (#14169) · 8d6cd32b
  Lu Fang authored Mar 05, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d6cd32b
- [V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
  Tyler Michael Smith authored Mar 05, 2025
  
  72c62eae
- [V1][TPU] TPU multimodal model support for ragged attention (#14158) · fbfc3ee3
  Michael Goin authored Mar 04, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  fbfc3ee3
04 Mar, 2025 1 commit
- [TPU][Profiler] Support start_profile/stop_profile in TPU worker (#13988) · beebf474
  Siyuan Liu authored Mar 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  beebf474
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 1 commit
- [Misc] Accurately capture the time of loading weights (#14063) · 82fbeae9
  Jun Duan authored Mar 01, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  82fbeae9
28 Feb, 2025 2 commits
- [v1] Cleanup the BlockTable in InputBatch (#13977) · e7bd944e
  Chen Zhang authored Mar 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e7bd944e
- [V1][TPU] Integrate the new ragged paged attention kernel with vLLM v1 on TPU (#13379) · c3b6559a
  iefgnoix authored Feb 28, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  c3b6559a
27 Feb, 2025 2 commits
- [V1][Minor] Minor cleanup for GPU Model Runner (#13983) · cd813c6d
  Woosuk Kwon authored Feb 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cd813c6d
- [Attention] MLA support for V1 (#13789) · 58d1b2aa
  Yang Chen authored Feb 27, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  58d1b2aa
26 Feb, 2025 1 commit
- [V1][Spec Decode] Change Spec Decode Rejection Sampling API (#13729) · 5629f26d
  Lily Liu authored Feb 25, 2025
  
  5629f26d
25 Feb, 2025 3 commits
- [Core] LoRA V1 - Add add/pin/list/remove_lora functions (#13705) · 03f48b3d
  Varun Sundar Rabindranath authored Feb 25, 2025
  
  03f48b3d
- [Misc] set single whitespace between log sentences (#13771) · 51010a18
  cjackal authored Feb 25, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  51010a18
- Remove unused kwargs from model definitions (#13555) · cdc1fa12
  Harry Mellor authored Feb 25, 2025
  
  cdc1fa12
24 Feb, 2025 2 commits
- Revert "[V1][Core] Fix memory issue with logits & sampling" (#13775) · 22757848
  Roger Wang authored Feb 24, 2025
  
  22757848
- [V1][Core] Fix memory issue with logits & sampling (#13721) · 437b76ff
  Roger Wang authored Feb 24, 2025
  
  437b76ff
23 Feb, 2025 1 commit
- [v1] torchrun compatibility (#13642) · eb24dc4a
  youkaichao authored Feb 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb24dc4a
22 Feb, 2025 6 commits
- [ci] fix linter (#13701) · 2382ad29
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2382ad29
- [core] set up data parallel communication (#13591) · 3e472d88
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3e472d88
- [CI/Build] Fix pre-commit errors (#13696) · 7f6bae56
  Cyrus Leung authored Feb 22, 2025
  
  7f6bae56
- [Bugfix] V1 Memory Profiling: V0 Sampler Integration without Rejection Sampler (#13594) · da31b533
  Jennifer Zhao authored Feb 22, 2025
```
Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  da31b533
- [v1] Support allowed_token_ids in v1 Sampler (#13210) · bb78fb31
  Lu Fang authored Feb 21, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  bb78fb31
- [Misc] Capture and log the time of loading weights (#13666) · 68d535ef
  Jun Duan authored Feb 22, 2025
  
  68d535ef
21 Feb, 2025 1 commit
- [V1][Sampler] Avoid an operation during temperature application (#13587) · 31aa045c
  Nick Hill authored Feb 20, 2025
  
  31aa045c
18 Feb, 2025 3 commits
- [V1][Spec Decode] Optimize N-gram matching with Numba (#13365) · 4c822298
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c822298
- [V1] Optimize handling of sampling metadata and req_ids list (#13244) · 30172b49
  Nick Hill authored Feb 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  30172b49
- [v1] fix parallel config rank (#13445) · 932b51ce
  youkaichao authored Feb 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  932b51ce
17 Feb, 2025 4 commits
- [V1][Spec decode] Move drafter to model runner (#13363) · cd4a72a2
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cd4a72a2
- [V1][PP] Fix intermediate tensor values (#13417) · 6ac485a9
  Cody Yu authored Feb 17, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  6ac485a9
- [V1] Get input tokens from scheduler (#13339) · 4c21ce9e
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c21ce9e
- [V1][Misc] Avoid unnecessary log output (#13289) · 2010f04c
  Jee Jee Li authored Feb 17, 2025
  
  2010f04c
16 Feb, 2025 2 commits
- [V1][PP] Cache Intermediate Tensors (#13353) · e18227b0
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e18227b0
- [V1][Spec Decode] Ngram Spec Decode (#12193) · 80f63a39
  Lily Liu authored Feb 15, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  80f63a39
15 Feb, 2025 1 commit
- [V1][PP] Fix memory profiling in PP (#13315) · 0c730268
  Woosuk Kwon authored Feb 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0c730268