Commits · 6fc2a38b110f9ba6037b31ee016f20df32426877 · norm / vllm

20 Jul, 2023 1 commit
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
09 Jul, 2023 1 commit
- [Model] Add support for GPT-J (#226) · c8948361
  Andre Slavescu authored Jul 08, 2023
```
Co-authored-by: woWoosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8948361
03 Jul, 2023 2 commits
- [Model] Add support for MPT (#334) · 404422f4
  Woosuk Kwon authored Jul 03, 2023
  
  404422f4
- Add support for BLOOM (#331) · e41f0670
  Woosuk Kwon authored Jul 03, 2023
  
  e41f0670
29 Jun, 2023 1 commit
- Add news for the vllm+skypilot example (#314) · f7229756
  Zhanghao Wu authored Jun 29, 2023
  
  f7229756
26 Jun, 2023 1 commit
- [Doc] Documentation for distributed inference (#261) · 2cf1a333
  Zhuohan Li authored Jun 26, 2023
  
  2cf1a333
25 Jun, 2023 1 commit
- Update README.md (#236) · 6214dd6c
  Lianmin Zheng authored Jun 25, 2023
  
  6214dd6c
22 Jun, 2023 1 commit
- [Docs] Add GPTBigCode to supported models (#213) · 665c4896
  Woosuk Kwon authored Jun 22, 2023
  
  665c4896
20 Jun, 2023 6 commits
- Remove e.g. in README (#167) · 033f5c78
  Zhuohan Li authored Jun 20, 2023
  
  033f5c78
- [Minor] Fix URLs (#166) · 794e578d
  Woosuk Kwon authored Jun 19, 2023
  
  794e578d
- Change image urls (#164) · fc72e39d
  Zhuohan Li authored Jun 20, 2023
  
  fc72e39d
- Fix repo & documentation URLs (#163) · b7e62d34
  Woosuk Kwon authored Jun 19, 2023
  
  b7e62d34
- [Docs] Minor fix (#162) · 364536ac
  Woosuk Kwon authored Jun 19, 2023
  
  364536ac
- Add and list supported models in README (#161) · 0b32a987
  Zhuohan Li authored Jun 20, 2023
  
  0b32a987
19 Jun, 2023 1 commit
- Add logo and polish readme (#156) · a255885f
  Zhuohan Li authored Jun 19, 2023
  
  a255885f
18 Jun, 2023 1 commit
- Write README and front page of doc (#147) · dcda03b4
  Woosuk Kwon authored Jun 18, 2023
  
  dcda03b4
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
20 May, 2023 1 commit
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f
07 May, 2023 1 commit
- Specify python package dependencies in requirements.txt (#78) · 7addca59
  Woosuk Kwon authored May 07, 2023
  
  7addca59
05 May, 2023 1 commit
- Replace FlashAttention with xformers (#70) · c9d5b6d4
  Woosuk Kwon authored May 05, 2023
  
  c9d5b6d4
02 Apr, 2023 1 commit
- Add ninja to dependency (#21) · 2c5cd0de
  Woosuk Kwon authored Apr 01, 2023
  
  2c5cd0de
31 Mar, 2023 1 commit
- Modify README to include info on loading LLaMA (#18) · e3f00d19
  Zhuohan Li authored Apr 01, 2023
  
  e3f00d19
30 Mar, 2023 1 commit
- Implement LLaMA (#9) · 80a2f812
  Woosuk Kwon authored Mar 29, 2023
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  80a2f812
29 Mar, 2023 1 commit
- FastAPI-based working frontend (#10) · 721fa3df
  Zhuohan Li authored Mar 29, 2023
  
  721fa3df
21 Mar, 2023 1 commit
- Support tensor parallel (#2) · 2f49f155
  Zhuohan Li authored Mar 22, 2023
  
  2f49f155
12 Mar, 2023 1 commit
- Add memory analyzer & utomatically configure KV cache size (#6) · e9d3f2ff
  Woosuk Kwon authored Mar 11, 2023
  
  e9d3f2ff
02 Mar, 2023 1 commit
- Use FlashAttention for `multi_query_kv_attention` (#4) · 3e9f991d
  Woosuk Kwon authored Mar 01, 2023
  
  3e9f991d
24 Feb, 2023 1 commit
- Add README · c84c708a
  Woosuk Kwon authored Feb 24, 2023
  
  c84c708a
09 Feb, 2023 1 commit
- Initial commit · e7d9d9c0
  Woosuk Kwon authored Feb 09, 2023
  
  e7d9d9c0