Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
c6ca5159
Unverified
Commit
c6ca5159
authored
Feb 26, 2026
by
Li-Yongwen
Committed by
GitHub
Feb 26, 2026
Browse files
[Bugfix] fix device_name for routing replay (#34336)
Signed-off-by:
liyongwen
<
1310439159@qq.com
>
parent
c0615a29
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
vllm/model_executor/layers/fused_moe/routed_experts_capturer.py
...odel_executor/layers/fused_moe/routed_experts_capturer.py
+2
-1
No files found.
vllm/model_executor/layers/fused_moe/routed_experts_capturer.py
View file @
c6ca5159
...
@@ -20,6 +20,7 @@ import torch
...
@@ -20,6 +20,7 @@ import torch
from
vllm.config
import
VllmConfig
from
vllm.config
import
VllmConfig
from
vllm.distributed
import
get_tensor_model_parallel_rank
from
vllm.distributed
import
get_tensor_model_parallel_rank
from
vllm.forward_context
import
get_forward_context
from
vllm.forward_context
import
get_forward_context
from
vllm.platforms
import
current_platform
logger
=
logging
.
getLogger
(
__name__
)
logger
=
logging
.
getLogger
(
__name__
)
...
@@ -132,7 +133,7 @@ class RoutedExpertsCapturer:
...
@@ -132,7 +133,7 @@ class RoutedExpertsCapturer:
self
.
_device_buffer
=
torch
.
zeros
(
self
.
_device_buffer
=
torch
.
zeros
(
(
max_num_batched_tokens
,
num_layers
,
num_experts_per_tok
),
(
max_num_batched_tokens
,
num_layers
,
num_experts_per_tok
),
dtype
=
torch
.
int32
,
dtype
=
torch
.
int32
,
device
=
"
cu
da"
,
device
=
cu
rrent_platform
.
device_type
,
)
)
self
.
dp_rank
=
vllm_config
.
parallel_config
.
data_parallel_rank
self
.
dp_rank
=
vllm_config
.
parallel_config
.
data_parallel_rank
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment