megatron/training.py · 7ce373f3de67a8ff393baa00de25b16b5039c497 · wxj / Megatron-LM · GitLab

"benchmarks/kernels/benchmark_rope.py" did not exist on "8d5187cb25f1abd684e60962c4532338a19d2f3a"

Find file Blame History Permalink

Bugfix in megatron/training.py: correct global_batch_size computation · 7ce373f3
Deepak Narayanan authored Oct 29, 2020
```
Prevents data_loader from running out of training examples
```
7ce373f3

training.py 29.8 KB