GitLab

Adding proper test cases

See merge request ADLR/megatron-lm!460

'

'

Setter for pipeline parallel split rank, remove print

See merge request ADLR/megatron-lm!454

Also merged in some changed from apex

Clean up licensing.

See merge request ADLR/megatron-lm!451

The LICENSE file says everything is 3-clause BSD, which is what we want,
but at some point the Apache license was added to the top of some files
and that proliferated. This commit removes the Apache license from any
files that we own the copyright to.

Also updates the copyright year and removes the unnessary coding=utf-8
line.

Update state_dict arguments for recent PyTorch versions.

See merge request ADLR/megatron-lm!432

Memory safety checks were incorrect for the tokens_to_generate=0 case

See merge request ADLR/megatron-lm!447

fixed grad scalar warning for bf16

See merge request ADLR/megatron-lm!442