Commits · e9d3f2ff7772c8efe41dc805cec71c223ec18ec8 · norm / vllm

12 Mar, 2023 1 commit
- Add memory analyzer & utomatically configure KV cache size (#6) · e9d3f2ff
  Woosuk Kwon authored Mar 11, 2023
  
  e9d3f2ff
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
24 Feb, 2023 4 commits
- Add Frontend · 1132fae0
  Woosuk Kwon authored Feb 24, 2023
  
  1132fae0
- Merge pre_step and step · ef6098ec
  Woosuk Kwon authored Feb 24, 2023
  
  ef6098ec
- Reduce the number of states in scheduler · 53f70e73
  Woosuk Kwon authored Feb 24, 2023
  
  53f70e73
- [WIP] Add server script · afdbe5d3
  Woosuk Kwon authored Feb 24, 2023
  
  afdbe5d3
23 Feb, 2023 2 commits
- Minor · fdd0f2f4
  Woosuk Kwon authored Feb 23, 2023
  
  fdd0f2f4
- Implement scheduler.step & Add a threshold for batch size · 331fa0b0
  Woosuk Kwon authored Feb 23, 2023
  
  331fa0b0
14 Feb, 2023 1 commit
- Fix bugs in scheduler · 7e5f604e
  Woosuk Kwon authored Feb 14, 2023
  
  7e5f604e
13 Feb, 2023 3 commits
- Fix typo · 531e1c74
  Woosuk Kwon authored Feb 13, 2023
  
  531e1c74
- Fix scheduler · d3d31766
  Woosuk Kwon authored Feb 13, 2023
  
  d3d31766
- Add scheduler · 5a309bb5
  Woosuk Kwon authored Feb 13, 2023
  
  5a309bb5