Commits · 25b79d9fd38e2c53ce281be23241d8939ec7320c · OpenDAS / vllm_cscc

09 Dec, 2024 1 commit

[V1] Input Batch Relocation (#10962) · 25b79d9f

Varun Sundar Rabindranath authored Dec 09, 2024


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

25b79d9f

05 Dec, 2024 1 commit
- [V1] Fix when max_model_len is not divisible by block_size (#10903) · 2a56e126
  Woosuk Kwon authored Dec 04, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2a56e126
03 Dec, 2024 1 commit
- [torch.compile] remove compilation_context and simplify code (#10838) · dc5ce861
  youkaichao authored Dec 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dc5ce861
26 Nov, 2024 2 commits
- [V1] Refactor model executable interface for multimodal models (#10570) · 2f0a0a17
  Roger Wang authored Nov 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2f0a0a17
- custom allreduce + torch.compile (#10121) · 9a88f897
  Sage Moore authored Nov 26, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  9a88f897
23 Nov, 2024 1 commit
- [V1] EngineCore supports profiling (#10564) · d345f409
  Zhonghua Deng authored Nov 23, 2024
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  d345f409
22 Nov, 2024 1 commit
- [torch.compile] support all attention backends (#10558) · eebad39f
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eebad39f
21 Nov, 2024 2 commits
- [V1] Fix Compilation config & Enable CUDA graph by default (#10528) · f9310cbd
  Woosuk Kwon authored Nov 21, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f9310cbd
- [torch.compile] Inductor code caching fix (#10273) · 8b0fe06c
  Luka Govedič authored Nov 21, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
```
  8b0fe06c
19 Nov, 2024 1 commit
- [6/N] torch.compile rollout to users (#10437) · 803f37ea
  youkaichao authored Nov 19, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  803f37ea
17 Nov, 2024 1 commit
- [2/N][torch.compile] make compilation cfg part of vllm cfg (#10383) · 4fd93750
  youkaichao authored Nov 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4fd93750
13 Nov, 2024 2 commits
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
- [V1] Support VLMs with fine-grained scheduling (#9871) · bbd3e869
  Woosuk Kwon authored Nov 12, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  bbd3e869
12 Nov, 2024 1 commit
- [V1] Enable Inductor when using piecewise CUDA graphs (#10268) · 1f55e057
  Woosuk Kwon authored Nov 12, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1f55e057
11 Nov, 2024 3 commits
- [V1] Enable custom ops with piecewise CUDA graphs (#10228) · 9d5b4e4d
  Woosuk Kwon authored Nov 11, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9d5b4e4d
- [V1] Use custom ops for piecewise CUDA graphs (#10227) · fe15729a
  Woosuk Kwon authored Nov 11, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  fe15729a
- [V1] Do not use inductor for piecewise CUDA graphs (#10225) · d7a4f220
  Woosuk Kwon authored Nov 11, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d7a4f220
08 Nov, 2024 1 commit
- [V1] Fix non-cudagraph op name (#10166) · b5815c84
  Woosuk Kwon authored Nov 08, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5815c84
07 Nov, 2024 1 commit
- [V1][BugFix] Fix Generator construction in greedy + seed case (#10097) · 1fa020c5
  Nick Hill authored Nov 07, 2024
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  1fa020c5
06 Nov, 2024 2 commits
- [V1] Make v1 more testable (#9888) · d58268c5
  Joe Runde authored Nov 06, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  d58268c5
- [V1] Integrate Piecewise CUDA graphs (#10058) · 40899855
  Woosuk Kwon authored Nov 05, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  40899855
03 Nov, 2024 1 commit
- [V1] Support per-request seed (#9945) · 1f1b6d6e
  Nick Hill authored Nov 03, 2024
```
Signed-off-by: Nick Hill <nickhill@us.ibm.com>
```
  1f1b6d6e
02 Nov, 2024 2 commits
- [3/N] model runner pass the whole config to model (#9958) · cea808f3
  youkaichao authored Nov 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  cea808f3
- [2/N] executor pass the complete config to worker/modelrunner (#9938) · e8937954
  youkaichao authored Nov 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  e8937954
22 Oct, 2024 1 commit
- [V1] Implement vLLM V1 [1/N] (#9289) · 6c5af09b
  Woosuk Kwon authored Oct 22, 2024
  
  6c5af09b