Commits · 0fca3cdcf265cd375bca684d951702b6b7adf65a · OpenDAS / vllm_cscc

13 May, 2024 1 commit
- [Misc] Enhance attention selector (#4751) · 0fca3cdc
  Woosuk Kwon authored May 13, 2024
  
  0fca3cdc
08 May, 2024 1 commit
- [Misc] Use vllm-flash-attn instead of flash-attn (#4686) · 89579a20
  Woosuk Kwon authored May 08, 2024
  
  89579a20
03 May, 2024 1 commit
- [Kernel] Use flashinfer for decoding (#4353) · 43c413ec
  Lily Liu authored May 03, 2024
```
Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>
```
  43c413ec
02 May, 2024 1 commit
- [Misc] centralize all usage of environment variables (#4548) · 5b8a7c1c
  youkaichao authored May 02, 2024
  
  5b8a7c1c
25 Apr, 2024 1 commit
- [Misc] Fix flash attention backend log (#4368) · b6dcb4d4
  Roy authored Apr 26, 2024
  
  b6dcb4d4
11 Apr, 2024 1 commit
- [Test] Add xformer and flash attn tests (#3961) · e42df722
  SangBin Cho authored Apr 11, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  e42df722
09 Apr, 2024 1 commit

[ROCm][Hardware][AMD] Use Triton Kernel for default FA on ROCm (#3643) · 6c0b0451

Juan Villamizar authored Apr 09, 2024


Co-authored-by: jpvillam <jpvillam@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

6c0b0451

02 Apr, 2024 1 commit

[Hardware][Intel] Add CPU inference backend (#3634) · 0e3f06fe

bigPYJ1151 authored Apr 02, 2024


Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>

0e3f06fe

29 Mar, 2024 1 commit
- [Misc] Minor type annotation fix (#3716) · 395aa823
  Woosuk Kwon authored Mar 28, 2024
  
  395aa823
28 Mar, 2024 1 commit
- fix logging msg for block manager (#3701) · 4716a32d
  Simon Mo authored Mar 28, 2024
  
  4716a32d
25 Mar, 2024 2 commits
- [CI] Try introducing isort. (#3495) · 01bfb22b
  SangBin Cho authored Mar 25, 2024
  
  01bfb22b
- [Core] Refactor Attention Take 2 (#3462) · 925f3332
  Woosuk Kwon authored Mar 24, 2024
  
  925f3332