Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
a45f4c2a
Commit
a45f4c2a
authored
Jan 17, 2025
by
wxj
Browse files
Update language_model.py
parent
b2f70020
Pipeline
#2226
passed with stage
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
megatron/legacy/model/language_model.py
megatron/legacy/model/language_model.py
+1
-1
No files found.
megatron/legacy/model/language_model.py
View file @
a45f4c2a
...
@@ -471,7 +471,7 @@ class TransformerLanguageModel(MegatronModule):
...
@@ -471,7 +471,7 @@ class TransformerLanguageModel(MegatronModule):
else
:
else
:
raise
Exception
(
'Stage must have at least either encoder or decoder'
)
raise
Exception
(
'Stage must have at least either encoder or decoder'
)
@
torch
.
compile
(
mode
=
"max-autotune-no-cudagraphs"
)
#
@torch.compile(mode="max-autotune-no-cudagraphs")
def
forward
(
def
forward
(
self
,
self
,
enc_input_ids
,
enc_input_ids
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment