Commits · 84eee24e20ff4c0fc1b126289265f560089efa47 · norm / vllm

12 Apr, 2023 1 commit
- Collect system stats in scheduler & Add scripts for experiments (#30) · 84eee24e
  Woosuk Kwon authored Apr 12, 2023
  
  84eee24e
30 Mar, 2023 1 commit
- Implement preemption via recomputation & Refactor scheduling logic (#12) · 7a7929ab
  Woosuk Kwon authored Mar 30, 2023
  
  7a7929ab
29 Mar, 2023 1 commit
- FastAPI-based working frontend (#10) · 721fa3df
  Zhuohan Li authored Mar 29, 2023
  
  721fa3df
13 Mar, 2023 1 commit
- Add miscellaneous updates (#8) · cfae35b8
  Woosuk Kwon authored Mar 13, 2023
  
  cfae35b8
12 Mar, 2023 1 commit
- Add memory analyzer & utomatically configure KV cache size (#6) · e9d3f2ff
  Woosuk Kwon authored Mar 11, 2023
  
  e9d3f2ff
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
24 Feb, 2023 4 commits
- Add Frontend · 1132fae0
  Woosuk Kwon authored Feb 24, 2023
  
  1132fae0
- Merge pre_step and step · ef6098ec
  Woosuk Kwon authored Feb 24, 2023
  
  ef6098ec
- Reduce the number of states in scheduler · 53f70e73
  Woosuk Kwon authored Feb 24, 2023
  
  53f70e73
- [WIP] Add server script · afdbe5d3
  Woosuk Kwon authored Feb 24, 2023
  
  afdbe5d3
23 Feb, 2023 2 commits
- Minor · fdd0f2f4
  Woosuk Kwon authored Feb 23, 2023
  
  fdd0f2f4
- Implement scheduler.step & Add a threshold for batch size · 331fa0b0
  Woosuk Kwon authored Feb 23, 2023
  
  331fa0b0
14 Feb, 2023 1 commit
- Fix bugs in scheduler · 7e5f604e
  Woosuk Kwon authored Feb 14, 2023
  
  7e5f604e
13 Feb, 2023 3 commits
- Fix typo · 531e1c74
  Woosuk Kwon authored Feb 13, 2023
  
  531e1c74
- Fix scheduler · d3d31766
  Woosuk Kwon authored Feb 13, 2023
  
  d3d31766
- Add scheduler · 5a309bb5
  Woosuk Kwon authored Feb 13, 2023
  
  5a309bb5