Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
ea8489fc
Unverified
Commit
ea8489fc
authored
Jan 29, 2024
by
Rasmus Larsen
Committed by
GitHub
Jan 29, 2024
Browse files
ROCm: Allow setting compilation target (#2581)
parent
1b20639a
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
5 deletions
+9
-5
setup.py
setup.py
+9
-5
No files found.
setup.py
View file @
ea8489fc
...
...
@@ -287,11 +287,15 @@ if _is_cuda():
},
))
elif
_is_hip
():
amd_arch
=
get_amdgpu_offload_arch
()
if
amd_arch
not
in
ROCM_SUPPORTED_ARCHS
:
raise
RuntimeError
(
f
"Only the following arch is supported:
{
ROCM_SUPPORTED_ARCHS
}
"
f
"amdgpu_arch_found:
{
amd_arch
}
"
)
amd_archs
=
os
.
getenv
(
"GPU_ARCHS"
)
if
amd_archs
is
None
:
amd_archs
=
get_amdgpu_offload_arch
()
for
arch
in
amd_archs
.
split
(
";"
):
if
arch
not
in
ROCM_SUPPORTED_ARCHS
:
raise
RuntimeError
(
f
"Only the following arch is supported:
{
ROCM_SUPPORTED_ARCHS
}
"
f
"amdgpu_arch_found:
{
arch
}
"
)
NVCC_FLAGS
+=
[
f
"--offload-arch=
{
arch
}
"
]
elif
_is_neuron
():
neuronxcc_version
=
get_neuronxcc_version
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment