Commits · e9d3f2ff7772c8efe41dc805cec71c223ec18ec8 · norm / vllm

10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
01 Mar, 2023 1 commit
- Implement `single_query_cached_kv_attention` kernel (#3) · 0deacbce
  Woosuk Kwon authored Mar 01, 2023
  
  0deacbce
23 Feb, 2023 4 commits
- Set default dtype to half · 1ce13335
  Woosuk Kwon authored Feb 23, 2023
  
  1ce13335
- Minor · fdd0f2f4
  Woosuk Kwon authored Feb 23, 2023
  
  fdd0f2f4
- Add seq_ids to input metadata · 343cea3d
  Woosuk Kwon authored Feb 23, 2023
  
  343cea3d
- Fix slot mapping · 4b1ac23f
  Woosuk Kwon authored Feb 23, 2023
  
  4b1ac23f
22 Feb, 2023 1 commit
- Add Worker class · 8290fce4
  Woosuk Kwon authored Feb 22, 2023
  
  8290fce4