Commits · 721fa3df155e5649bbe2188517594f24f4e63523 · xdb4_94051 / vllm

"tools/vscode:/vscode.git/clone" did not exist on "5f2cb263fbf6d8ef4324e1f553fde362e2ba9082"

29 Mar, 2023 1 commit
- FastAPI-based working frontend (#10) · 721fa3df
  Zhuohan Li authored Mar 29, 2023
  
  721fa3df
21 Mar, 2023 1 commit
- Support tensor parallel (#2) · 2f49f155
  Zhuohan Li authored Mar 22, 2023
  
  2f49f155
13 Mar, 2023 1 commit
- Add miscellaneous updates (#8) · cfae35b8
  Woosuk Kwon authored Mar 13, 2023
  
  cfae35b8
12 Mar, 2023 1 commit
- Add memory analyzer & utomatically configure KV cache size (#6) · e9d3f2ff
  Woosuk Kwon authored Mar 11, 2023
  
  e9d3f2ff
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
06 Mar, 2023 1 commit
- Fix a bug in 1D input shape (#5) · 04e5acc0
  Woosuk Kwon authored Mar 06, 2023
  
  04e5acc0
02 Mar, 2023 1 commit
- Use FlashAttention for `multi_query_kv_attention` (#4) · 3e9f991d
  Woosuk Kwon authored Mar 01, 2023
  
  3e9f991d
24 Feb, 2023 2 commits
- Clean up the server script · fa16389a
  Woosuk Kwon authored Feb 24, 2023
  
  fa16389a
- [WIP] Add server script · afdbe5d3
  Woosuk Kwon authored Feb 24, 2023
  
  afdbe5d3