Commits · 9cabcb76453e7d8384d1858663f1841cef174c2c · norm / vllm

17 Oct, 2023 1 commit
- Change scheduler & input tensor shape (#1381) · c1376e0f
  Woosuk Kwon authored Oct 16, 2023
  
  c1376e0f
02 Sep, 2023 1 commit
- Avoid compiling kernels for double data type (#933) · 8ce9c50d
  Woosuk Kwon authored Sep 02, 2023
  
  8ce9c50d
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
03 May, 2023 1 commit
- Support bfloat16 data type (#54) · e070829a
  Woosuk Kwon authored May 03, 2023
  
  e070829a
11 Apr, 2023 1 commit
- Memcpy kernel for flash attention (#29) · e3cec88a
  Siyuan (Ryans) Zhuang authored Apr 10, 2023
```
* optimize

* add benchmark

* add assert

* add test
```
  e3cec88a
08 Apr, 2023 1 commit
- Implement block copy kernel to optimize beam search (#32) · 0f40557a
  Woosuk Kwon authored Apr 07, 2023
  
  0f40557a
02 Apr, 2023 1 commit
- Optimize data movement (#20) · 897cb2ae
  Woosuk Kwon authored Apr 02, 2023
  
  897cb2ae
30 Mar, 2023 1 commit
- Implement custom kernel for LLaMA rotary embedding (#14) · 88c0268a
  Woosuk Kwon authored Mar 30, 2023
  
  88c0268a
13 Mar, 2023 1 commit
- Add miscellaneous updates (#8) · cfae35b8
  Woosuk Kwon authored Mar 13, 2023
  
  cfae35b8
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
01 Mar, 2023 1 commit
- Implement `single_query_cached_kv_attention` kernel (#3) · 0deacbce
  Woosuk Kwon authored Mar 01, 2023
  
  0deacbce
18 Feb, 2023 1 commit
- Add reshape_and_cache op · c413c41c
  Woosuk Kwon authored Feb 18, 2023
  
  c413c41c
16 Feb, 2023 2 commits
- cache_kernel -> cache_kernels · ffad4e1e
  Woosuk Kwon authored Feb 16, 2023
  
  ffad4e1e
- Implement cache ops · 6f058c7b
  Woosuk Kwon authored Feb 16, 2023
  
  6f058c7b