use half atomicAdd of dtk24.04

3f1166ab · zhuwenwen · f0647bb8 · 3f1166ab
Commit 3f1166ab authored Mar 23, 2024 by zhuwenwen
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

csrc/quantization/gptq/q_gemm.cu csrc/quantization/gptq/q_gemm.cu +2 -0

No files found.
--- a/csrc/quantization/gptq/q_gemm.cu
+++ b/csrc/quantization/gptq/q_gemm.cu
@@ -11,7 +11,9 @@ Adapted from https://github.com/turboderp/exllamav2 and https://github.com/qwopq
 #include <cuda_runtime.h>
 #include <cuda_fp16.h>

+#ifndef USE_ROCM
 #include "compat.cuh"
+#endif
 #include "matrix_view.cuh"
 #include "qdq_2.cuh"
 #include "qdq_3.cuh"