Commits · 9f659bf07fa3aa0183f2d36b09abaa5ef7cbd77a · norm / vllm

04 Jan, 2024 1 commit
- Revert the changes in test_cache (#2335) · 94176712
  Woosuk Kwon authored Jan 03, 2024
  
  94176712
03 Jan, 2024 2 commits
- Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) · fd4ea8ef
  Zhuohan Li authored Jan 04, 2024
  
  fd4ea8ef
- [FIX] Support non-zero CUDA devices in custom kernels (#1959) · 77af974b
  Jee Li authored Jan 03, 2024
  
  77af974b
24 Nov, 2023 1 commit
- [Build] Avoid building too many extensions (#1624) · e0c6f556
  Yanming W authored Nov 23, 2023
  
  e0c6f556
31 Oct, 2023 1 commit
- Fix integer overflows in attention & cache ops (#1514) · 0ce8647d
  Woosuk Kwon authored Oct 31, 2023
  
  0ce8647d
02 Oct, 2023 1 commit
- TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181) · ba0bfd40
  Zhuohan Li authored Oct 02, 2023
  
  ba0bfd40
05 Sep, 2023 1 commit
- Clean up kernel unit tests (#938) · fbd80ad4
  Woosuk Kwon authored Sep 06, 2023
  
  fbd80ad4
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
18 May, 2023 1 commit
- Use pytest format for unit tests (#107) · 825d8892
  Woosuk Kwon authored May 17, 2023
  
  825d8892
05 May, 2023 1 commit
- Replace FlashAttention with xformers (#70) · c9d5b6d4
  Woosuk Kwon authored May 05, 2023
  
  c9d5b6d4
11 Apr, 2023 1 commit
- Memcpy kernel for flash attention (#29) · e3cec88a
  Siyuan (Ryans) Zhuang authored Apr 10, 2023
```
* optimize

* add benchmark

* add assert

* add test
```
  e3cec88a
08 Apr, 2023 1 commit
- Implement block copy kernel to optimize beam search (#32) · 0f40557a
  Woosuk Kwon authored Apr 07, 2023
  
  0f40557a
02 Apr, 2023 1 commit
- Optimize data movement (#20) · 897cb2ae
  Woosuk Kwon authored Apr 02, 2023
  
  897cb2ae
01 Mar, 2023 1 commit
- Implement `single_query_cached_kv_attention` kernel (#3) · 0deacbce
  Woosuk Kwon authored Mar 01, 2023
  
  0deacbce
18 Feb, 2023 1 commit
- Add tests for kernels · af68ec1c
  Woosuk Kwon authored Feb 18, 2023
  
  af68ec1c