GitLab

Update state_dict arguments for recent PyTorch versions.

See merge request ADLR/megatron-lm!432

Memory safety checks were incorrect for the tokens_to_generate=0 case

See merge request ADLR/megatron-lm!447

fixed grad scalar warning for bf16

See merge request ADLR/megatron-lm!442

fixed grad scalar warning so it only prints it for fp16

See merge request ADLR/megatron-lm!441

Timing levels

See merge request ADLR/megatron-lm!436

fix a bug for size mismatch

See merge request ADLR/megatron-lm!438

support for all mask in fused kernel + avoiding inplace operation in bwd pass

See merge request ADLR/megatron-lm!435

added a flag to be able to switch between pytorch and ring exchange p2p

See merge request ADLR/megatron-lm!434

Remove old merge tool.

See merge request ADLR/megatron-lm!433

Remove deprecated destination argument to state_dict functions and make all arguments keyword to avoid warnings.

Adding checks for total number of tokens to keep server from crashing

See merge request ADLR/megatron-lm!428

Implements the top_p decay and top_p bound parameters so from the Factual Sampling work

See merge request ADLR/megatron-lm!423

Distributed optimizer readme section.

See merge request ADLR/megatron-lm!429

Checkpoint conversion utility

See merge request ADLR/megatron-lm!289

Fix bugs for beam search when using pipeline parallelization

See merge request ADLR/megatron-lm!426

Update ci image.

See merge request ADLR/megatron-lm!425