Commits · 721fa3df155e5649bbe2188517594f24f4e63523 · norm / vllm

29 Mar, 2023 1 commit
- FastAPI-based working frontend (#10) · 721fa3df
  Zhuohan Li authored Mar 29, 2023
  
  721fa3df
21 Mar, 2023 1 commit
- Support tensor parallel (#2) · 2f49f155
  Zhuohan Li authored Mar 22, 2023
  
  2f49f155
12 Mar, 2023 1 commit
- Add memory analyzer & utomatically configure KV cache size (#6) · e9d3f2ff
  Woosuk Kwon authored Mar 11, 2023
  
  e9d3f2ff
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
25 Feb, 2023 1 commit
- Fix a bug in tying OPT embeddings (#1) · cbf8779a
  Woosuk Kwon authored Feb 24, 2023
  
  cbf8779a
23 Feb, 2023 1 commit
- Set default dtype to half · 1ce13335
  Woosuk Kwon authored Feb 23, 2023
  
  1ce13335
22 Feb, 2023 2 commits
- Minor · 608f74ff
  Woosuk Kwon authored Feb 22, 2023
  
  608f74ff
- Move worker/models -> models · 709a6917
  Woosuk Kwon authored Feb 22, 2023
  
  709a6917
13 Feb, 2023 2 commits
- Fix get_model · ee944251
  Woosuk Kwon authored Feb 13, 2023
  
  ee944251
- Add model_utils · fffa2e1f
  Woosuk Kwon authored Feb 13, 2023
  
  fffa2e1f