"...git@developer.sourcefind.cn:chenpangpang/open-webui.git" did not exist on "550fc63ebd08de7c4108eef1aa302897db86aee8"
Commit 99a8a0c5 authored by wenjh's avatar wenjh
Browse files

Fix undeclare use_int8 error


Signed-off-by: wenjh's avatarwenjh <wenjh@sugon.com>
parent f7ffdbd4
......@@ -883,6 +883,9 @@ void nvte_cublas_atomic_gemm(const NVTETensor A, const NVTETensor B, NVTETensor
NVTE_ERROR("TT layout not allowed.");
}
const bool use_int8 = is_int8_dtype(inputA->data.dtype) ||
is_int8_dtype(inputB->data.dtype);
const char *NVTE_FORCE_ROCM_GEMM = std::getenv("NVTE_FORCE_ROCM_GEMM");
const bool use_fp8 = is_fp8_dtype(inputA->data.dtype) ||
is_fp8_dtype(inputB->data.dtype);
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment