Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
36e35fac
"cacheflow/master/simple_frontend.py" did not exist on "1132fae0ca7f6103b0dd7b96932c75f5ed780288"
Commit
36e35fac
authored
Feb 11, 2025
by
王敏
Browse files
修改错误代码
parent
10213be4
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
1 addition
and
8 deletions
+1
-8
vllm/_custom_ops.py
vllm/_custom_ops.py
+1
-1
vllm/model_executor/models/mixtral.py
vllm/model_executor/models/mixtral.py
+0
-7
No files found.
vllm/_custom_ops.py
View file @
36e35fac
...
...
@@ -1384,7 +1384,7 @@ def ep_moe_align_block_size(topk_ids: torch.Tensor, num_experts: int,
experts_ids
:
torch
.
Tensor
,
num_tokens_post_pad
:
torch
.
Tensor
,
start_expert
,
end_expert
)
->
None
:
torch
.
ops
.
_C
.
ep_moe_align_block_size
(
topk_ids
,
num_experts
,
block_size
,
torch
.
ops
.
_
moe_
C
.
ep_moe_align_block_size
(
topk_ids
,
num_experts
,
block_size
,
sorted_token_ids
,
experts_ids
,
num_tokens_post_pad
,
start_expert
,
end_expert
)
...
...
vllm/model_executor/models/mixtral.py
View file @
36e35fac
...
...
@@ -545,13 +545,6 @@ class MixtralForCausalLM(nn.Module, SupportsLoRA, SupportsPP):
for
layername
in
loaded_params
:
weight
=
params_dict
[
layername
]
if
"lm_head.weight"
in
layername
:
lay_key_words
.
append
(
"lm_head.weight"
)
combined_words
=
"|"
.
join
(
lay_key_words
)
os
.
environ
[
'LM_NN'
]
=
'1'
else
:
os
.
environ
[
'LM_NN'
]
=
'0'
matches
=
re
.
findall
(
combined_words
,
layername
)
if
matches
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment