Skip to content

GitLab

Unverified Commit ce4ecba4 authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

fix: only compile ApplyTokenBitmaskInplace cu124+ (#5686)

parent b1f6d89b
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
sgl-kernel/csrc/grammar/apply_token_bitmask_inplace_cuda.cu
View file @ ce4ecba4
......@@ -26,6 +26,8 @@
#include <ATen/cuda/CUDAContext.h>
// clang-format on
#if defined CUDA_VERSION && CUDA_VERSION >= 12040
#ifndef CUDART_INF_FP16
#define CUDART_INF_FP16 __ushort_as_half((unsigned short)0x7C00U)
#endif
......@@ -249,3 +251,4 @@ void ApplyTokenBitmaskInplace(at::Tensor logits, at::Tensor bitmask, at::optiona
break;
}
}
#endif
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment