Commits · 0b98ba15c744f1dfb0ea4f2135e85ca23d572ae1 · norm / vllm

17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
07 Jun, 2023 1 commit
- Support FP32 (#141) · e38074b1
  Woosuk Kwon authored Jun 07, 2023
  
  e38074b1
18 May, 2023 1 commit
- Use pytest format for unit tests (#107) · 825d8892
  Woosuk Kwon authored May 17, 2023
  
  825d8892
05 May, 2023 1 commit
- Replace FlashAttention with xformers (#70) · c9d5b6d4
  Woosuk Kwon authored May 05, 2023
  
  c9d5b6d4
03 May, 2023 1 commit
- Refactor attention kernels (#53) · 436e523b
  Woosuk Kwon authored May 03, 2023
  
  436e523b
10 Apr, 2023 1 commit
- Support block size 32 (#35) · b9926f7f
  Woosuk Kwon authored Apr 09, 2023
  
  b9926f7f
08 Apr, 2023 1 commit
- Add query stride to multi_query_cached_kv_attention & Add kernel benchmark script (#27) · c267b1a0
  Woosuk Kwon authored Apr 08, 2023
```
* Add query stride to multi_query_cached_kv_attention

* Add kernel benchmark script
```
  c267b1a0
05 Apr, 2023 1 commit
- Basic attention kernel that supports cached KV + (multi-)prompts (#24) · 21b3671b
  Siyuan (Ryans) Zhuang authored Apr 04, 2023
  
  21b3671b
02 Apr, 2023 1 commit
- Optimize data movement (#20) · 897cb2ae
  Woosuk Kwon authored Apr 02, 2023
  
  897cb2ae
30 Mar, 2023 1 commit
- Refactor the test code for attention kernels (#13) · a1b3de86
  Woosuk Kwon authored Mar 29, 2023
  
  a1b3de86
02 Mar, 2023 1 commit
- Use FlashAttention for `multi_query_kv_attention` (#4) · 3e9f991d
  Woosuk Kwon authored Mar 01, 2023
  
  3e9f991d
01 Mar, 2023 1 commit
- Implement `single_query_cached_kv_attention` kernel (#3) · 0deacbce
  Woosuk Kwon authored Mar 01, 2023
  
  0deacbce