Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
9073c4bd
Commit
9073c4bd
authored
Apr 16, 2020
by
Jared Casper
Browse files
Check that the dataset helpers make runs successfully.
parent
c6882114
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
1 deletion
+5
-1
megatron/data/dataset_utils.py
megatron/data/dataset_utils.py
+5
-1
No files found.
megatron/data/dataset_utils.py
View file @
9073c4bd
...
...
@@ -24,7 +24,11 @@ def compile_helper():
import
os
import
subprocess
path
=
os
.
path
.
abspath
(
os
.
path
.
dirname
(
__file__
))
subprocess
.
run
([
'make'
,
'-C'
,
path
])
ret
=
subprocess
.
run
([
'make'
,
'-C'
,
path
])
if
ret
.
returncode
!=
0
:
print
(
"Making C++ dataset helpers module failed, exiting."
)
import
sys
sys
.
exit
(
1
)
def
build_training_sample
(
sample
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment