Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ColossalAI
Commits
af388848
"docs/vscode:/vscode.git/clone" did not exist on "bce0f1670226ce2b4c8167b468257d25c8b6d885"
Unverified
Commit
af388848
authored
Mar 09, 2023
by
Tomek
Committed by
GitHub
Mar 09, 2023
Browse files
[example] fixed opt model downloading from huggingface
parent
2ca9728c
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
examples/language/opt/train_gemini_opt.py
examples/language/opt/train_gemini_opt.py
+1
-1
No files found.
examples/language/opt/train_gemini_opt.py
View file @
af388848
...
...
@@ -177,7 +177,7 @@ def main():
default_dist_spec
=
ShardSpec
([
-
1
],
[
world_size
])
if
args
.
shardinit
else
None
# build model
if
args
.
model_name_or_path
is
None
or
args
.
model_name_or_path
==
'facebook/opt-13b'
:
if
args
.
model_name_or_path
is
None
:
# currently, there has a bug in pretrained opt-13b
# we can not import it until huggingface fix it
logger
.
info
(
"Train a new model from scratch"
,
ranks
=
[
0
])
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment