Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ktransformers
Commits
234faf79
Commit
234faf79
authored
Sep 12, 2024
by
xhedit
Browse files
typo fix: KMisrtal -> KMistral
parent
3ed8a043
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
ktransformers/operators/experts.py
ktransformers/operators/experts.py
+1
-1
ktransformers/optimize/optimize_rules/Mixtral.yaml
ktransformers/optimize/optimize_rules/Mixtral.yaml
+1
-1
No files found.
ktransformers/operators/experts.py
View file @
234faf79
...
...
@@ -727,7 +727,7 @@ class KDeepseekV2MoE(BaseInjectedModule, DeepseekV2MoE):
)
return
final_out
class
KMis
r
talSparseMoEBlock
(
BaseInjectedModule
,
MixtralSparseMoeBlock
):
class
KMist
r
alSparseMoEBlock
(
BaseInjectedModule
,
MixtralSparseMoeBlock
):
def
forward
(
self
,
hidden_states
:
torch
.
Tensor
)
->
torch
.
Tensor
:
""" """
...
...
ktransformers/optimize/optimize_rules/Mixtral.yaml
View file @
234faf79
...
...
@@ -19,7 +19,7 @@
name
:
"
^model
\\
.layers
\\
..*
\\
.block_sparse_moe$"
class
:
ktransformers.models.modeling_mixtral.MixtralSparseMoeBlock
replace
:
class
:
ktransformers.operators.experts.KMis
r
talSparseMoEBlock
class
:
ktransformers.operators.experts.KMist
r
alSparseMoEBlock
-
match
:
name
:
"
^model
\\
.layers
\\
..*
\\
.block_sparse_moe
\\
.experts$"
replace
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment