Commits · e01c2beb7d1df1f388051f083a20ae9c0d552027 · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "1ffc8a73628ee8e3f6ad5aab54782d64050d17ea"

04 Sep, 2024 15 commits
- [Doc] [Misc] Create CODE_OF_CONDUCT.md (#8161) · e01c2beb
  Maureen McElaney authored Sep 04, 2024
  
  e01c2beb
- Bump version to v0.6.0 (#8166) · 32e7db25
  Simon Mo authored Sep 04, 2024
  
  32e7db25
- [Neuron] Adding support for adding/ overriding neuron configuration a… (#8062) · 008cf886
  Harsha vardhan manoj Bikki authored Sep 04, 2024
```
Co-authored-by: Harsha Bikki <harbikh@amazon.com>
```
  008cf886
- [MISC] Replace input token throughput with total token throughput (#8164) · 77d9e514
  Cody Yu authored Sep 04, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  77d9e514
- [Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649) · e02ce498
  Kyle Mistele authored Sep 04, 2024
```
Co-authored-by: constellate <constellate@1-ai-appserver-staging.codereach.com>
Co-authored-by: Kyle Mistele <kyle@constellate.ai>
```
  e02ce498
- [CI] Change test input in Gemma LoRA test (#8163) · 561d6f80
  Woosuk Kwon authored Sep 04, 2024
  
  561d6f80
- [CI/Build][ROCm] Enabling LoRA tests on ROCm (#7369) · d1dec642
  alexeykondrat authored Sep 04, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  d1dec642
- [MISC] Consolidate FP8 kv-cache tests (#8131) · 2ad2e560
  Cody Yu authored Sep 04, 2024
  
  2ad2e560
- [Bugfix] remove post_layernorm in siglip (#8106) · d3311562
  wnma authored Sep 04, 2024
  
  d3311562
- chore: Update check-wheel-size.py to read MAX_SIZE_MB from env (#8103) · ccd72071
  TimWang authored Sep 04, 2024
  
  ccd72071
- [Frontend] Multimodal support in offline chat (#8098) · 855c262a
  Cyrus Leung authored Sep 04, 2024
  
  855c262a
- [Model] Add Ultravox support for multiple audio chunks (#7963) · 2be8ec6e
  Peter Salas authored Sep 03, 2024
  
  2be8ec6e
- [Misc] Update fbgemmfp8 to use `vLLMParameters` (#7972) · e16fa99a
  Dipika Sikka authored Sep 03, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  e16fa99a
- [TPU][Bugfix] Use XLA rank for persistent cache path (#8137) · 61f4a93d
  Woosuk Kwon authored Sep 03, 2024
  
  61f4a93d
- [Benchmark] Add `--async-engine` option to benchmark_throughput.py (#7964) · d4db9f53
  Nick Hill authored Sep 03, 2024
  
  d4db9f53
03 Sep, 2024 11 commits
- [Misc] Update `GPTQ` to use `vLLMParameters` (#7976) · 2188a60c
  Dipika Sikka authored Sep 03, 2024
  
  2188a60c
- [CI] Change PR remainder to avoid at-mentions (#8134) · dc0b6066
  Simon Mo authored Sep 03, 2024
  
  dc0b6066
- [TPU][Bugfix] Fix next_token_ids shape (#8128) · 0af3abe3
  Woosuk Kwon authored Sep 03, 2024
  
  0af3abe3
- [ci] Fix GHA workflow (#8129) · f1575dc9
  Kevin H. Luu authored Sep 03, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  f1575dc9
- [CI/Build] make pip install vllm work in macos (for import only) (#8118) · c02638ef
  tomeras91 authored Sep 03, 2024
  
  c02638ef
- [Misc] Raise a more informative exception in add/remove_logger (#7750) · 652c83b6
  Antoni Baum authored Sep 03, 2024
  
  652c83b6
- [Core] Optimize Async + Multi-step (#8050) · 6d646d08
  Alexander Matveev authored Sep 03, 2024
  
  6d646d08
- [CI] Only PR reviewers/committers can trigger CI on PR (#8124) · 95a178f8
  Kevin H. Luu authored Sep 03, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  95a178f8
- [Performance] Enable chunked prefill and prefix caching together (#8120) · bd852f2a
  Cody Yu authored Sep 03, 2024
```
Co-authored-by: Tao He <sighingnow@gmail.com>
Co-authored-by: Juelianqvq <Juelianqvq@noreply.github.com>
```
  bd852f2a
- [Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061) · ec266536
  Isotr0py authored Sep 03, 2024
  
  ec266536
- [Bugfix] Fix single output condition in output processor (#7881) · 0fbc6696
  Woosuk Kwon authored Sep 02, 2024
  
  0fbc6696
02 Sep, 2024 6 commits
- improve chunked prefill performance · 6e36f4fa
  wang.yuqi authored Sep 03, 2024
```
[Bugfix] Fix #7592 vllm 0.5.4 enable_chunked_prefill throughput is slightly lower than 0.5.3~0.5.0. (#7874)
```
  6e36f4fa
- [Bugfix] Fix internlm2 tensor parallel inference (#8055) · dd2a6a82
  Isotr0py authored Sep 02, 2024
  
  dd2a6a82
- [Core][Bugfix] Accept GGUF model without .gguf extension (#8056) · 4ca65a97
  Isotr0py authored Sep 02, 2024
  
  4ca65a97
- [TPU] Align worker index with node boundary (#7932) · e2b2aa5a
  Woosuk Kwon authored Sep 01, 2024
  
  e2b2aa5a
- [SpecDecode][Kernel] Flashinfer Rejection Sampling (#7244) · e6a26ed0
  Lily Liu authored Sep 01, 2024
  
  e6a26ed0
- [Model] Add Granite model (#7436) · f8d60145
  Shawn Tan authored Sep 01, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  f8d60145
01 Sep, 2024 1 commit
- [Misc] Optional installation of audio related packages (#8063) · 5b86b199
  Roger Wang authored Sep 01, 2024
  
  5b86b199
31 Aug, 2024 5 commits
- [Frontend][VLM] Add support for multiple multi-modal items (#8049) · 5231f089
  Roger Wang authored Aug 31, 2024
  
  5231f089
- [BugFix][Core] Multistep Fix Crash on Request Cancellation (#8059) · 8423aef4
  Robert Shaw authored Aug 31, 2024
  
  8423aef4
- [Bugfix] Fix ModelScope models in v0.5.5 (#8037) · 4f5d8446
  Nicolò Lucchesi authored Aug 31, 2024
  
  4f5d8446
- [Bugfix] Fix import error in Phi-3.5-MoE (#8052) · d05f0a9d
  Cyrus Leung authored Aug 31, 2024
  
  d05f0a9d
- [Bugfix] bugfix and add model test for flashinfer fp8 kv cache. (#8013) · 622f8abf
  Pavani Majety authored Aug 30, 2024
  
  622f8abf
30 Aug, 2024 2 commits
- [Model] Adding support for MSFT Phi-3.5-MoE (#7729) · 1248e850
  Wenxiang authored Aug 31, 2024
```
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Zeqi Lin <zelin@microsoft.com>
Co-authored-by: Zeqi Lin <Zeqi.Lin@microsoft.com>
```
  1248e850
- [TPU][Bugfix] Fix tpu type api (#8035) · 2684efc4
  Woosuk Kwon authored Aug 30, 2024
  
  2684efc4