Skip to content

GitLab

Unverified Commit ce4ecba4 authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

fix: only compile ApplyTokenBitmaskInplace cu124+ (#5686)

parent b1f6d89b
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
sgl-kernel/csrc/grammar/apply_token_bitmask_inplace_cuda.cu
View file @ ce4ecba4
...@@ -26,6 +26,8 @@ ...@@ -26,6 +26,8 @@
#include <ATen/cuda/CUDAContext.h> #include <ATen/cuda/CUDAContext.h>
// clang-format on // clang-format on
#if defined CUDA_VERSION && CUDA_VERSION >= 12040
#ifndef CUDART_INF_FP16 #ifndef CUDART_INF_FP16
#define CUDART_INF_FP16 __ushort_as_half((unsigned short)0x7C00U) #define CUDART_INF_FP16 __ushort_as_half((unsigned short)0x7C00U)
#endif #endif
...@@ -249,3 +251,4 @@ void ApplyTokenBitmaskInplace(at::Tensor logits, at::Tensor bitmask, at::optiona ...@@ -249,3 +251,4 @@ void ApplyTokenBitmaskInplace(at::Tensor logits, at::Tensor bitmask, at::optiona
break; break;
} }
} }
#endif
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment