Commits · 47db6ec8310129699a62567b61d8ed380636b053 · OpenDAS / vllm_cscc

"tests/kernels/quantization/untest_marlin_gemm.py" did not exist on "0f41fbe5a370c0b87bb9a038be592c9272d46364"

11 Nov, 2024 2 commits

[V1] `AsyncLLM` Implementation (#9826) · 6ace6fba

Robert Shaw authored Nov 11, 2024


Signed-off-by: Nick Hill <nickhill@us.ibm.com>
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

6ace6fba

[V1] Allow `tokenizer_mode` and `trust_remote_code` for Detokenizer (#10211) · 5fb1f935
Roger Wang authored Nov 11, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
5fb1f935

09 Nov, 2024 1 commit

[Frontend][Core] Override HF `config.json` via CLI (#5836) · b09895a6

Krishna Mandal authored Nov 09, 2024


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

b09895a6

08 Nov, 2024 3 commits
- [V1]Enable APC by default only for text models (#10148) · 208ce622
  Roger Wang authored Nov 08, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  208ce622
- [V1] Prefix caching (take 2) (#9972) · 201fc077
  Cody Yu authored Nov 07, 2024
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  201fc077
- [V1] Add all_token_ids attribute to Request (#10135) · 42b4f46b
  Woosuk Kwon authored Nov 07, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  42b4f46b
06 Nov, 2024 1 commit
- [V1] Make v1 more testable (#9888) · d58268c5
  Joe Runde authored Nov 06, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  d58268c5
02 Nov, 2024 1 commit
- [2/N] executor pass the complete config to worker/modelrunner (#9938) · e8937954
  youkaichao authored Nov 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  e8937954
01 Nov, 2024 1 commit
- [1/N] pass the complete config from engine to executor (#9933) · 18bd7587
  youkaichao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  18bd7587
24 Oct, 2024 1 commit
- [V1][Bugfix] Clean up requests when aborted (#9629) · 3770071e
  Woosuk Kwon authored Oct 23, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3770071e
22 Oct, 2024 1 commit
- [V1] Implement vLLM V1 [1/N] (#9289) · 6c5af09b
  Woosuk Kwon authored Oct 22, 2024
  
  6c5af09b