Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8278825b
Unverified
Commit
8278825b
authored
Mar 31, 2026
by
Mateusz Sokół
Committed by
GitHub
Mar 31, 2026
Browse files
DOC: TPU mention fix (#38129)
Signed-off-by:
Mateusz Sokół
<
mat646@gmail.com
>
parent
acf7292b
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
2 deletions
+6
-2
vllm/config/parallel.py
vllm/config/parallel.py
+6
-2
No files found.
vllm/config/parallel.py
View file @
8278825b
...
...
@@ -214,14 +214,18 @@ class ParallelConfig:
distributed_executor_backend
:
(
str
|
DistributedExecutorBackend
|
type
[
Executor
]
|
None
)
=
None
"""Backend to use for distributed model workers, either "ray" or "mp"
"""
Backend to use for distributed model workers, either "ray" or "mp"
(multiprocessing). If the product of pipeline_parallel_size and tensor_parallel_size
is less than or equal to the number of GPUs available, "mp" will be used to
keep processing on a single host. Otherwise, an error will be raised. To use "mp"
you must also set nnodes, and to use "ray" you must manually set
distributed_executor_backend to "ray".
Note that tpu only support Ray for distributed inference."""
Note:
[TPU](https://docs.vllm.ai/projects/tpu/en/latest/) platform only supports Ray
for distributed inference.
"""
worker_cls
:
str
=
"auto"
"""The full name of the worker class to use. If "auto", the worker class
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment