Skip to content

GitLab

Unverified Commit 7ab643e4 authored by Alexei-V-Ivanov-AMD's avatar Alexei-V-Ivanov-AMD Committed by GitHub
Browse files

FIxing the AMD test failures caused by PR#16457 (#17511) 


Signed-off-by: default avatarAlexei V. Ivanov <alexei.ivanov@amd.com>
parent afb4429b
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 2 deletions
docker/Dockerfile.rocm
View file @ 7ab643e4
...@@ -118,4 +118,3 @@ ENV TOKENIZERS_PARALLELISM=false ...@@ -118,4 +118,3 @@ ENV TOKENIZERS_PARALLELISM=false
ENV HIP_FORCE_DEV_KERNARG=1 ENV HIP_FORCE_DEV_KERNARG=1
CMD ["/bin/bash"] CMD ["/bin/bash"]
vllm/model_executor/layers/rotary_embedding.py
View file @ 7ab643e4
...@@ -80,7 +80,7 @@ def _apply_rotary_emb(x: torch.Tensor, cos: torch.Tensor, sin: torch.Tensor, ...@@ -80,7 +80,7 @@ def _apply_rotary_emb(x: torch.Tensor, cos: torch.Tensor, sin: torch.Tensor,
is_neox_style: Whether to use the Neox-style or GPT-J-style rotary is_neox_style: Whether to use the Neox-style or GPT-J-style rotary
positional embeddings. positional embeddings.
""" """
if current_platform.is_cuda_alike(): if current_platform.is_cuda():
return apply_rotary_emb(x.unsqueeze(0), cos, sin, return apply_rotary_emb(x.unsqueeze(0), cos, sin,
not is_neox_style).squeeze(0) not is_neox_style).squeeze(0)
else: else:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment