Commits · d721168449281a5f5a299bba8d94523ad4e833cb · norm / vllm

27 May, 2023 1 commit
- Improve setup script & Add a guard for bfloat16 kernels (#130) · d7211684
  Woosuk Kwon authored May 27, 2023
  
  d7211684
07 May, 2023 1 commit
- Specify python package dependencies in requirements.txt (#78) · 7addca59
  Woosuk Kwon authored May 07, 2023
  
  7addca59
03 May, 2023 2 commits
- Support bfloat16 data type (#54) · e070829a
  Woosuk Kwon authored May 03, 2023
  
  e070829a
- Refactor attention kernels (#53) · 436e523b
  Woosuk Kwon authored May 03, 2023
  
  436e523b
02 Apr, 2023 1 commit
- Optimize data movement (#20) · 897cb2ae
  Woosuk Kwon authored Apr 02, 2023
  
  897cb2ae
31 Mar, 2023 1 commit
- Add custom kernel for RMS normalization (#16) · 09e92454
  Woosuk Kwon authored Mar 31, 2023
  
  09e92454
30 Mar, 2023 1 commit
- Implement custom kernel for LLaMA rotary embedding (#14) · 88c0268a
  Woosuk Kwon authored Mar 30, 2023
  
  88c0268a
01 Mar, 2023 1 commit
- Implement `single_query_cached_kv_attention` kernel (#3) · 0deacbce
  Woosuk Kwon authored Mar 01, 2023
  
  0deacbce
16 Feb, 2023 2 commits
- cache_kernel -> cache_kernels · ffad4e1e
  Woosuk Kwon authored Feb 16, 2023
  
  ffad4e1e
- Implement cache ops · 6f058c7b
  Woosuk Kwon authored Feb 16, 2023
  
  6f058c7b
09 Feb, 2023 1 commit
- Add blank setup file · 3be29a11
  Woosuk Kwon authored Feb 09, 2023
  
  3be29a11