Commits · abfcdcdf27eb54d2a2104b4bf5091a24ea4ff928 · OpenDAS / vllm_cscc

02 Feb, 2025 1 commit

[V1][Minor] Avoid frequently creating ConstantList (#12653) · abfcdcdf

Woosuk Kwon authored Feb 01, 2025



A small optimization to avoid creating a new `ConstantList` every time `request.kv_block_hashes` is used.
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

abfcdcdf

26 Jan, 2025 1 commit
- [V1][Bugfix] Fix assertion when mm hashing is turned off (#12439) · 0ee349b5
  Roger Wang authored Jan 26, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0ee349b5
22 Jan, 2025 1 commit
- [Frontend][V1] Online serving performance improvements (#12287) · aea94362
  Nick Hill authored Jan 22, 2025
  
  aea94362
06 Jan, 2025 1 commit

[V1] Extend beyond image modality and support mixed-modality inference with... · 91b361ae

Roger Wang authored Jan 06, 2025


[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

91b361ae

18 Dec, 2024 1 commit
- [V1] Prefix caching for vision language models (#11187) · bf8717eb
  Cody Yu authored Dec 17, 2024
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  bf8717eb
14 Dec, 2024 1 commit
- Enable mypy checking on V1 code (#11105) · 6d917d0e
  Mark McLoughlin authored Dec 14, 2024
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  6d917d0e
03 Dec, 2024 1 commit

[V1] VLM - Run the mm_mapper preprocessor in the frontend process (#10640) · 3bc94cab

Alexander Matveev authored Dec 03, 2024


Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

3bc94cab

13 Nov, 2024 2 commits
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
- [V1] Support VLMs with fine-grained scheduling (#9871) · bbd3e869
  Woosuk Kwon authored Nov 12, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  bbd3e869
11 Nov, 2024 1 commit

[V1] `AsyncLLM` Implementation (#9826) · 6ace6fba

Robert Shaw authored Nov 11, 2024


Signed-off-by: Nick Hill <nickhill@us.ibm.com>
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

6ace6fba

08 Nov, 2024 1 commit
- [V1] Add all_token_ids attribute to Request (#10135) · 42b4f46b
  Woosuk Kwon authored Nov 07, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  42b4f46b
22 Oct, 2024 1 commit
- [V1] Implement vLLM V1 [1/N] (#9289) · 6c5af09b
  Woosuk Kwon authored Oct 22, 2024
  
  6c5af09b