Commits · 1591c68fdea97a213d5564f687009c4fd1b44608 · OpenDAS / vllm_cscc

03 May, 2024 2 commits
- [Kernel] Use flashinfer for decoding (#4353) · 43c413ec
  Lily Liu authored May 03, 2024
```
Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>
```
  43c413ec
- [Core][Model runner refactoring 1/N] Refactor attn metadata term (#4518) · 3521ba4f
  SangBin Cho authored May 04, 2024
  
  3521ba4f
02 May, 2024 2 commits
- [kernel] fix sliding window in prefix prefill Triton kernel (#4405) · 32881f3f
  Michał Moskal authored May 02, 2024
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  32881f3f
- [Misc] centralize all usage of environment variables (#4548) · 5b8a7c1c
  youkaichao authored May 02, 2024
  
  5b8a7c1c
27 Apr, 2024 1 commit
- [ROCm][Hardware][AMD] Enable group query attention for triton FA (#4406) · 18d23f64
  Hongxia Yang authored Apr 27, 2024
  
  18d23f64
23 Apr, 2024 1 commit
- [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) · 0ae11f78
  SangBin Cho authored Apr 23, 2024
  
  0ae11f78
22 Apr, 2024 1 commit
- [AMD][Hardware][Misc][Bugfix] xformer cleanup and light navi logic and CI... · 95e5b087
  Hongxia Yang authored Apr 22, 2024
```
[AMD][Hardware][Misc][Bugfix] xformer cleanup and light navi logic and CI fixes and refactoring (#4129)
```
  95e5b087
12 Apr, 2024 1 commit
- [Test] Test multiple attn backend for chunked prefill. (#4023) · 36729bac
  SangBin Cho authored Apr 13, 2024
  
  36729bac
11 Apr, 2024 2 commits
- [Hardware][Intel] Isolate CPUModelRunner and ModelRunner for better maintenance (#3824) · 8afca508
  bigPYJ1151 authored Apr 12, 2024
  
  8afca508
- [Core][5/N] Fully working chunked prefill e2e (#3884) · 67b4221a
  SangBin Cho authored Apr 11, 2024
  
  67b4221a
09 Apr, 2024 1 commit

[ROCm][Hardware][AMD] Use Triton Kernel for default FA on ROCm (#3643) · 6c0b0451

Juan Villamizar authored Apr 09, 2024


Co-authored-by: jpvillam <jpvillam@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

6c0b0451

04 Apr, 2024 1 commit
- [Bugfix] Add kv_scale input parameter to CPU backend (#3840) · 498eb5cf
  Woosuk Kwon authored Apr 03, 2024
  
  498eb5cf
03 Apr, 2024 1 commit

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290) · 2ff767b5

Adrian Abeyta authored Apr 03, 2024


Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: AdrianAbeyta <Adrian.Abeyta@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: root <root@gt-pla-u18-08.pla.dcgpu>
Co-authored-by: mawong-amd <156021403+mawong-amd@users.noreply.github.com>
Co-authored-by: ttbachyinsda <ttbachyinsda@outlook.com>
Co-authored-by: guofangze <guofangze@kuaishou.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: jacobthebanana <50071502+jacobthebanana@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2ff767b5

02 Apr, 2024 1 commit

[Hardware][Intel] Add CPU inference backend (#3634) · 0e3f06fe

bigPYJ1151 authored Apr 02, 2024


Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>

0e3f06fe

29 Mar, 2024 1 commit
- [ROCm][Bugfix] Fixed several bugs related to rccl path and attention selector logic (#3699) · 9765b5c4
  Hongxia Yang authored Mar 29, 2024
  
  9765b5c4
25 Mar, 2024 2 commits
- [CI] Try introducing isort. (#3495) · 01bfb22b
  SangBin Cho authored Mar 25, 2024
  
  01bfb22b
- [Core] Refactor Attention Take 2 (#3462) · 925f3332
  Woosuk Kwon authored Mar 24, 2024
  
  925f3332