Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
1ecc645b
Unverified
Commit
1ecc645b
authored
Dec 19, 2024
by
youkaichao
Committed by
GitHub
Dec 19, 2024
Browse files
[doc] backward compatibility for 0.6.4 (#11359)
Signed-off-by:
youkaichao
<
youkaichao@gmail.com
>
parent
c954f21a
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
0 deletions
+5
-0
docs/source/getting_started/debugging.rst
docs/source/getting_started/debugging.rst
+5
-0
No files found.
docs/source/getting_started/debugging.rst
View file @
1ecc645b
...
...
@@ -86,6 +86,11 @@ If GPU/CPU communication cannot be established, you can use the following Python
from vllm.distributed.device_communicators.pynccl import PyNcclCommunicator
pynccl = PyNcclCommunicator(group=gloo_group, device=local_rank)
# pynccl is enabled by default for 0.6.5+,
# but for 0.6.4 and below, we need to enable it manually.
# keep the code for backward compatibility when because people
# prefer to read the latest documentation.
pynccl.disabled = False
s = torch.cuda.Stream()
with torch.cuda.stream(s):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment