Commits · e983c8047a73dff85d5c2959d907eaa0cbd73069 · OpenDAS / vllm_cscc

19 Mar, 2025 2 commits
- add --gpu-max-threads-per-block=1024 to fix rms_norm_kernel accuracy · e983c804
  zhuwenwen authored Mar 19, 2025
  
  e983c804
- skip fp8 kernel and _rocm_C extension · 9e053941
  zhuwenwen authored Mar 19, 2025
  
  9e053941
13 Feb, 2025 1 commit
- [NVIDIA] Support nvfp4 quantization (#12784) · 4fc5c23b
  Kaixi Hou authored Feb 12, 2025
  
  4fc5c23b
27 Jan, 2025 1 commit
- [Build] Only build 9.0a for scaled_mm and sparse kernels (#12339) · 103bd17a
  Lucas Wilkinson authored Jan 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  103bd17a
15 Jan, 2025 1 commit
- Allow hip sources to be directly included when compiling for rocm. (#12087) · cd9d06fb
  tvirolai-amd authored Jan 15, 2025
  
  cd9d06fb
27 Oct, 2024 1 commit

[Misc] Upgrade to pytorch 2.5 (#9588) · 3cb07a36

bnellnm authored Oct 27, 2024


Signed-off-by: Bill Nell <bill@neuralmagic.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

3cb07a36

04 Oct, 2024 1 commit
- [CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (#8845) · aeb37c2a
  Lucas Wilkinson authored Oct 03, 2024
  
  aeb37c2a
21 Sep, 2024 1 commit
- [Kernel] Build flash-attn from source (#8245) · 71c60491
  Luka Govedič authored Sep 21, 2024
  
  71c60491
19 Sep, 2024 1 commit
- [Misc] guard against change in cuda library name (#8609) · de6f90a1
  bnellnm authored Sep 19, 2024
  
  de6f90a1
11 Sep, 2024 1 commit
- [Kernel][Misc] register ops to prevent graph breaks (#6917) · 73202dbe
  bnellnm authored Sep 11, 2024
```
Co-authored-by: Sage Moore <sage@neuralmagic.com>
```
  73202dbe
04 Aug, 2024 1 commit
- Clean up remaining Punica C information (#7027) · f80ab352
  Jee Jee Li authored Aug 05, 2024
  
  f80ab352
25 Jun, 2024 1 commit
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
19 Jun, 2024 1 commit
- [Bugfix][CI/Build][AMD][ROCm]Fixed the cmake build bug which generate garbage... · f758aed0
  Hongxia Yang authored Jun 19, 2024
```
[Bugfix][CI/Build][AMD][ROCm]Fixed the cmake build bug which generate garbage on certain devices (#5641)
```
  f758aed0
09 Jun, 2024 1 commit
- [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) · 5467ac31
  bnellnm authored Jun 09, 2024
  
  5467ac31
10 May, 2024 1 commit
- [Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (#4535) · c8331017
  Cody Yu authored May 09, 2024
  
  c8331017
08 Apr, 2024 1 commit
- [Hotfix][CI/Build][Kernel] CUDA 11.8 does not support layernorm optimizations (#3782) · 59a6abf3
  Matt Wong authored Apr 08, 2024
  
  59a6abf3
03 Apr, 2024 1 commit

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290) · 2ff767b5

Adrian Abeyta authored Apr 03, 2024


Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: AdrianAbeyta <Adrian.Abeyta@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: root <root@gt-pla-u18-08.pla.dcgpu>
Co-authored-by: mawong-amd <156021403+mawong-amd@users.noreply.github.com>
Co-authored-by: ttbachyinsda <ttbachyinsda@outlook.com>
Co-authored-by: guofangze <guofangze@kuaishou.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: jacobthebanana <50071502+jacobthebanana@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2ff767b5

30 Mar, 2024 3 commits
- [Kernel] Layernorm performance optimization (#3662) · b6d10354
  mawong-amd authored Mar 30, 2024
  
  b6d10354
- CMake build elf without PTX (#3739) · 51c31bc1
  Simon Mo authored Mar 29, 2024
  
  51c31bc1
- Fix build when nvtools is missing (#3698) · 3ad438c6
  bnellnm authored Mar 29, 2024
  
  3ad438c6
18 Mar, 2024 1 commit
- Cmake based build system (#2830) · 9fdf3de3
  bnellnm authored Mar 18, 2024
  
  9fdf3de3