Skip to content

GitLab

Unverified Commit d2af6744 authored by Kunshang Ji's avatar Kunshang Ji Committed by GitHub
Browse files

[XPU][Triton]add xpu config in triton_reshape_and_cache_flash (#25643) 


Signed-off-by: default avatarKunshang Ji <kunshang.ji@intel.com>
parent 0bcc3a16
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/attention/ops/triton_reshape_and_cache_flash.py
View file @ d2af6744
...@@ -137,7 +137,7 @@ def triton_reshape_and_cache_flash( ...@@ -137,7 +137,7 @@ def triton_reshape_and_cache_flash(
# heuristics instead of autotuning # heuristics instead of autotuning
TILE_SIZE = min(2048, triton.next_power_of_2(n)) TILE_SIZE = min(2048, triton.next_power_of_2(n))
if torch.version.hip: if torch.version.hip or torch.version.xpu:
num_stages = 4 num_stages = 4
num_warps = 8 num_warps = 8
else: # cuda else: # cuda
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment