Commits · cfae35b861c5fc0c9f3689f99c7aba2e4501beb8 · norm / vllm

12 Mar, 2023 1 commit
- Add memory analyzer & utomatically configure KV cache size (#6) · e9d3f2ff
  Woosuk Kwon authored Mar 11, 2023
  
  e9d3f2ff
02 Mar, 2023 1 commit
- Use FlashAttention for `multi_query_kv_attention` (#4) · 3e9f991d
  Woosuk Kwon authored Mar 01, 2023
  
  3e9f991d
24 Feb, 2023 1 commit
- Add README · c84c708a
  Woosuk Kwon authored Feb 24, 2023
  
  c84c708a
09 Feb, 2023 1 commit
- Initial commit · e7d9d9c0
  Woosuk Kwon authored Feb 09, 2023
  
  e7d9d9c0