Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
236f11df
Commit
236f11df
authored
Aug 07, 2025
by
zhuwenwen
Browse files
update rocm Stream
parent
77a29416
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
vllm/utils/__init__.py
vllm/utils/__init__.py
+3
-3
No files found.
vllm/utils/__init__.py
View file @
236f11df
...
@@ -1428,9 +1428,9 @@ def current_stream() -> torch.cuda.Stream:
...
@@ -1428,9 +1428,9 @@ def current_stream() -> torch.cuda.Stream:
# per process
# per process
# fix computational precision issue in eager mode
# fix computational precision issue in eager mode
#
_current_stream_tls.value = torch.cuda.Stream(
_current_stream_tls
.
value
=
torch
.
cuda
.
Stream
(
#
) if current_platform.is_rocm() else torch.cuda.current_stream()
)
if
current_platform
.
is_rocm
()
else
torch
.
cuda
.
current_stream
()
_current_stream_tls
.
value
=
torch
.
cuda
.
current_stream
()
#
_current_stream_tls.value = torch.cuda.current_stream()
return
_current_stream_tls
.
value
return
_current_stream_tls
.
value
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment