Commits · d0740dff1b3ab06860316d98c937a3d4e143f25f · norm / vllm

14 Oct, 2023 1 commit
- Fix error message on `TORCH_CUDA_ARCH_LIST` (#1239) · d0740dff
  Woosuk Kwon authored Oct 14, 2023
```
Co-authored-by: Yunfeng Bai <yunfeng.bai@scale.com>
```
  d0740dff
27 Sep, 2023 1 commit
- Allocate more shared memory to attention kernel (#1154) · cf5cb1e3
  Antoni Baum authored Sep 26, 2023
  
  cf5cb1e3
26 Sep, 2023 1 commit
- [Setup] Enable `TORCH_CUDA_ARCH_LIST` for selecting target GPUs (#1074) · a425bd9a
  Woosuk Kwon authored Sep 26, 2023
  
  a425bd9a
16 Sep, 2023 1 commit

Implement AWQ quantization support for LLaMA (#1032) · e3e79e9e

Woosuk Kwon authored Sep 16, 2023


Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>

e3e79e9e

11 Sep, 2023 1 commit
- Update setup.py (#1006) · d6770d1f
  Woosuk Kwon authored Sep 10, 2023
  
  d6770d1f
22 Aug, 2023 1 commit
- Add compute capability 8.9 to default targets (#829) · a41c2043
  Woosuk Kwon authored Aug 23, 2023
  
  a41c2043
21 Aug, 2023 1 commit
- set default coompute capability according to cuda version (#773) · 65fc1c31
  Xudong Zhang authored Aug 22, 2023
  
  65fc1c31
27 Jun, 2023 1 commit
- Update setup.py (#282) · 2b7d3aca
  Cody Yu authored Jun 27, 2023
```
Co-authored-by: neubig <neubig@gmail.com>
```
  2b7d3aca
20 Jun, 2023 1 commit
- [PyPI] Fix package info in setup.py (#158) · 570fb2e9
  Woosuk Kwon authored Jun 19, 2023
  
  570fb2e9
18 Jun, 2023 1 commit
- Write README and front page of doc (#147) · dcda03b4
  Woosuk Kwon authored Jun 18, 2023
  
  dcda03b4
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
07 Jun, 2023 1 commit
- Support FP32 (#141) · e38074b1
  Woosuk Kwon authored Jun 07, 2023
  
  e38074b1
06 Jun, 2023 1 commit
- [PyPI] Packaging for PyPI distribution (#140) · 376725ce
  Woosuk Kwon authored Jun 05, 2023
  
  376725ce
27 May, 2023 1 commit
- Improve setup script & Add a guard for bfloat16 kernels (#130) · d7211684
  Woosuk Kwon authored May 27, 2023
  
  d7211684
07 May, 2023 1 commit
- Specify python package dependencies in requirements.txt (#78) · 7addca59
  Woosuk Kwon authored May 07, 2023
  
  7addca59
03 May, 2023 2 commits
- Support bfloat16 data type (#54) · e070829a
  Woosuk Kwon authored May 03, 2023
  
  e070829a
- Refactor attention kernels (#53) · 436e523b
  Woosuk Kwon authored May 03, 2023
  
  436e523b
02 Apr, 2023 1 commit
- Optimize data movement (#20) · 897cb2ae
  Woosuk Kwon authored Apr 02, 2023
  
  897cb2ae
31 Mar, 2023 1 commit
- Add custom kernel for RMS normalization (#16) · 09e92454
  Woosuk Kwon authored Mar 31, 2023
  
  09e92454
30 Mar, 2023 1 commit
- Implement custom kernel for LLaMA rotary embedding (#14) · 88c0268a
  Woosuk Kwon authored Mar 30, 2023
  
  88c0268a
01 Mar, 2023 1 commit
- Implement `single_query_cached_kv_attention` kernel (#3) · 0deacbce
  Woosuk Kwon authored Mar 01, 2023
  
  0deacbce
16 Feb, 2023 2 commits
- cache_kernel -> cache_kernels · ffad4e1e
  Woosuk Kwon authored Feb 16, 2023
  
  ffad4e1e
- Implement cache ops · 6f058c7b
  Woosuk Kwon authored Feb 16, 2023
  
  6f058c7b
09 Feb, 2023 1 commit
- Add blank setup file · 3be29a11
  Woosuk Kwon authored Feb 09, 2023
  
  3be29a11