Commits · e9d3f2ff7772c8efe41dc805cec71c223ec18ec8 · norm / vllm

12 Mar, 2023 1 commit
- Add memory analyzer & utomatically configure KV cache size (#6) · e9d3f2ff
  Woosuk Kwon authored Mar 11, 2023
  
  e9d3f2ff
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
22 Feb, 2023 2 commits
- Add input metadata · 7b6844e5
  Woosuk Kwon authored Feb 22, 2023
  
  7b6844e5
- Move worker/models -> models · 709a6917
  Woosuk Kwon authored Feb 22, 2023
  
  709a6917
13 Feb, 2023 1 commit
- Add model_utils · fffa2e1f
  Woosuk Kwon authored Feb 13, 2023
  
  fffa2e1f
09 Feb, 2023 1 commit
- Add OPT · 39161c98
  Woosuk Kwon authored Feb 09, 2023
  
  39161c98