call makefile every run so we recompile if the code has changed

f0232865 · mohammad · c0400306 · f0232865
Commit f0232865 authored Jan 25, 2021 by mohammad
Show whitespace changes
Inline Side-by-side

Showing with 5 additions and 8 deletions

megatron/initialize.py megatron/initialize.py +5 -8

No files found.
--- a/megatron/initialize.py
+++ b/megatron/initialize.py
@@ -80,9 +80,6 @@ def initialize_megatron(extra_args_provider=None, args_defaults={},
        _init_autoresume()
        # Compile dataset C++ code.
-        try:
-            from megatron.data import helpers
-        except:
        if torch.distributed.get_rank() == 0:
            from megatron.data.dataset_utils import compile_helper
            compile_helper()