Commits · 7addca5935c83806429d7ec557999a505e6f6a35 · norm / vllm

07 May, 2023 1 commit
- Specify python package dependencies in requirements.txt (#78) · 7addca59
  Woosuk Kwon authored May 07, 2023
  
  7addca59
05 May, 2023 1 commit
- Replace FlashAttention with xformers (#70) · c9d5b6d4
  Woosuk Kwon authored May 05, 2023
  
  c9d5b6d4
02 Apr, 2023 1 commit
- Add ninja to dependency (#21) · 2c5cd0de
  Woosuk Kwon authored Apr 01, 2023
  
  2c5cd0de
31 Mar, 2023 1 commit
- Modify README to include info on loading LLaMA (#18) · e3f00d19
  Zhuohan Li authored Apr 01, 2023
  
  e3f00d19
30 Mar, 2023 1 commit
- Implement LLaMA (#9) · 80a2f812
  Woosuk Kwon authored Mar 29, 2023
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  80a2f812
29 Mar, 2023 1 commit
- FastAPI-based working frontend (#10) · 721fa3df
  Zhuohan Li authored Mar 29, 2023
  
  721fa3df
21 Mar, 2023 1 commit
- Support tensor parallel (#2) · 2f49f155
  Zhuohan Li authored Mar 22, 2023
  
  2f49f155
12 Mar, 2023 1 commit
- Add memory analyzer & utomatically configure KV cache size (#6) · e9d3f2ff
  Woosuk Kwon authored Mar 11, 2023
  
  e9d3f2ff
02 Mar, 2023 1 commit
- Use FlashAttention for `multi_query_kv_attention` (#4) · 3e9f991d
  Woosuk Kwon authored Mar 01, 2023
  
  3e9f991d
24 Feb, 2023 1 commit
- Add README · c84c708a
  Woosuk Kwon authored Feb 24, 2023
  
  c84c708a
09 Feb, 2023 1 commit
- Initial commit · e7d9d9c0
  Woosuk Kwon authored Feb 09, 2023
  
  e7d9d9c0