Commits · 294104c3f9ab471d2d571b6a6eda266af3824d6a · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "37bfee92bf4159f5839d9bed6b2fb2b96db4e741"

26 Jun, 2024 14 commits
- [doc] update usage of env var to avoid conflict (#5873) · 294104c3
  youkaichao authored Jun 26, 2024
  
  294104c3
- Support CPU inference with VSX PowerPC ISA (#5652) · 38a1674a
  Chip Kerchner authored Jun 26, 2024
  
  38a1674a
- [Bugfix][TPU] Fix CPU cache allocation (#5869) · f5c8628f
  Woosuk Kwon authored Jun 26, 2024
  
  f5c8628f
- [Hardware][TPU] Support parallel sampling & Swapping (#5855) · cbc53b6b
  Woosuk Kwon authored Jun 26, 2024
  
  cbc53b6b
- [Frontend] Add tokenize/detokenize endpoints (#5054) · c54269d9
  sasha0552 authored Jun 26, 2024
  
  c54269d9
- [Kernel] Adding bias epilogue support for `cutlass_scaled_mm` (#5560) · 5bfd1bbc
  Luka Govedič authored Jun 26, 2024
```
Co-authored-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  5bfd1bbc
- [CI/Build] Refactor image test assets (#5821) · 6984c02a
  Cyrus Leung authored Jun 26, 2024
  
  6984c02a
- [Bugfix][TPU] Fix KV cache size calculation (#5860) · 3439c5a8
  Woosuk Kwon authored Jun 26, 2024
  
  3439c5a8
- [Bugfix] Fix embedding to support 2D inputs (#5829) · 6806998b
  Woosuk Kwon authored Jun 26, 2024
  
  6806998b
- [bugfix][distributed] fix shm broadcast when the queue size is full (#5801) · 515080ad
  youkaichao authored Jun 25, 2024
  
  515080ad
- [Misc][Doc] Add Example of using OpenAI Server with VLM (#5832) · 3aa7b6cf
  Roger Wang authored Jun 25, 2024
  
  3aa7b6cf
- [Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408) · dda48115
  Stephanie Wang authored Jun 25, 2024
```
Signed-off-by: Stephanie Wang <swang@cs.berkeley.edu>
Signed-off-by: Stephanie <swang@anyscale.com>
Co-authored-by: Stephanie <swang@anyscale.com>
```
  dda48115
- [Bugfix] Fix assertion in NeuronExecutor (#5841) · 82079729
  aws-patlange authored Jun 25, 2024
  
  82079729
- [CI/Build] Add E2E tests for MLPSpeculator (#5791) · c2a8ac75
  Thomas Parnell authored Jun 26, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  c2a8ac75
25 Jun, 2024 11 commits
- [Hardware][TPU] Raise errors for unsupported sampling params (#5850) · f178e56c
  Woosuk Kwon authored Jun 25, 2024
  
  f178e56c
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
- [Hardware][TPU] Refactor TPU backend (#5831) · bc34937d
  Woosuk Kwon authored Jun 25, 2024
  
  bc34937d
- [Misc] Update `w4a16` `compressed-tensors` support to include `w8a16` (#5794) · dd248f76
  Dipika Sikka authored Jun 25, 2024
  
  dd248f76
- [CI/Build] Add unit testing for FlexibleArgumentParser (#5798) · d9b34bae
  Michael Goin authored Jun 25, 2024
  
  d9b34bae
- [doc][distributed] add both gloo and nccl tests (#5834) · c18ebfdd
  youkaichao authored Jun 25, 2024
  
  c18ebfdd
- [Core] Add fault tolerance for `RayTokenizerGroupPool` (#5748) · 67882dbb
  Antoni Baum authored Jun 25, 2024
  
  67882dbb
- [Misc] Remove useless code in cpu_worker (#5824) · 7b993143
  Jie Fu (傅杰) authored Jun 26, 2024
  
  7b993143
- [Speculative Decoding] Support draft model on different tensor-parallel size... · 2ce5d668
  Woo-Yeon Lee authored Jun 25, 2024
```
 [Speculative Decoding] Support draft model on different tensor-parallel size than target model (#5414)
```
  2ce5d668
- [Doc] Add notice about breaking changes to VLMs (#5818) · f23871e9
  Cyrus Leung authored Jun 25, 2024
  
  f23871e9
- [ci] Remove aws template (#5757) · e9de9dd5
  Kevin H. Luu authored Jun 24, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  e9de9dd5
24 Jun, 2024 5 commits
- [Bugfix] Fix FlexibleArgumentParser replaces _ with - for actual args (#5795) · ba991d5c
  Chang Su authored Jun 24, 2024
  
  ba991d5c
- [Doc] Add Phi-3-medium to list of supported models (#5788) · 1744cc99
  Michael Goin authored Jun 24, 2024
  
  1744cc99
- [Doc] Add "Suggest edit" button to doc pages (#5789) · e72dc6cb
  Michael Goin authored Jun 24, 2024
  
  e72dc6cb
- [doc][faq] add warning to download models for every nodes (#5783) · c2462129
  youkaichao authored Jun 24, 2024
  
  c2462129
- [Bugfix] Add phi3v resize for dynamic shape and fix torchvision requirement (#5772) · edd5fe5f
  Isotr0py authored Jun 24, 2024
  
  edd5fe5f
23 Jun, 2024 2 commits
- [Distributed] Add send and recv helpers (#5719) · 5d4d9053
  Murali Andoorveedu authored Jun 23, 2024
  
  5d4d9053
- [BugFix] [Kernel] Add Cutlass2x fallback kernels (#5744) · 6c916ac8
  Varun Sundar Rabindranath authored Jun 24, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  6c916ac8
22 Jun, 2024 6 commits
- [core][distributed] improve shared memory broadcast (#5754) · 832ea88f
  youkaichao authored Jun 22, 2024
  
  832ea88f
- [Docs][TPU] Add installation tip for TPU (#5761) · 8c00f9c1
  Woosuk Kwon authored Jun 21, 2024
  
  8c00f9c1
- [Bugfix] Fix pin_lora error in TPU executor (#5760) · 0cbc1d2b
  Woosuk Kwon authored Jun 21, 2024
  
  0cbc1d2b
- [Misc] Remove #4789 workaround left in vllm/entrypoints/openai/run_batch.py (#5756) · ff9ddbce
  zifeitong authored Jun 21, 2024
  
  ff9ddbce
- [Model] Support Qwen-VL and Qwen-VL-Chat models with text-only inputs (#5710) · 9c62db07
  Jie Fu (傅杰) authored Jun 22, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  9c62db07
- [CI][Hardware][Intel GPU] add Intel GPU(XPU) ci pipeline (#5616) · cf90ae01
  Kunshang Ji authored Jun 22, 2024
  
  cf90ae01
21 Jun, 2024 2 commits
- [LoRA] Add support for pinning lora adapters in the LRU cache (#5603) · f5dda63e
  rohithkrn authored Jun 21, 2024
  
  f5dda63e
- [ci][test] fix ca test in main (#5746) · 71875073
  youkaichao authored Jun 21, 2024
  
  71875073