Commits · 7297fa6f7c4ce6413ee005025b312c4c9d4f5f0b · norm / vllm

15 May, 2023 1 commit
- Add docstrings to some modules and classes (#100) · b322fd16
  Woosuk Kwon authored May 14, 2023
  
  b322fd16
08 Apr, 2023 1 commit
- Implement block copy kernel to optimize beam search (#32) · 0f40557a
  Woosuk Kwon authored Apr 07, 2023
  
  0f40557a
21 Mar, 2023 1 commit
- Support tensor parallel (#2) · 2f49f155
  Zhuohan Li authored Mar 22, 2023
  
  2f49f155
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
01 Mar, 2023 1 commit
- Implement `single_query_cached_kv_attention` kernel (#3) · 0deacbce
  Woosuk Kwon authored Mar 01, 2023
  
  0deacbce
16 Feb, 2023 5 commits
- Implement cache ops · 6f058c7b
  Woosuk Kwon authored Feb 16, 2023
  
  6f058c7b
- Minor · a1c67e6d
  Woosuk Kwon authored Feb 16, 2023
  
  a1c67e6d
- Fix return type error · 9e68a682
  Woosuk Kwon authored Feb 16, 2023
  
  9e68a682
- Add warning · 8edcabc7
  Woosuk Kwon authored Feb 16, 2023
  
  8edcabc7
- Fix KVCache shape · 2f4887de
  Woosuk Kwon authored Feb 16, 2023
  
  2f4887de
13 Feb, 2023 1 commit
- Fix cache engine · bb59a3e7
  Woosuk Kwon authored Feb 13, 2023
  
  bb59a3e7
09 Feb, 2023 1 commit
- Add cache engine · e7bee2aa
  Woosuk Kwon authored Feb 09, 2023
  
  e7bee2aa