GitLab

Fix bug in merge_mp_partitions for handling recent checkpoints.

See merge request ADLR/megatron-lm!226

Handle empty documents in preprocess_data.

See merge request ADLR/megatron-lm!225

Init CI tests with very basic import test.

See merge request ADLR/megatron-lm!224

added option to change tensorboard queue size

See merge request ADLR/megatron-lm!223

added options for tensorboard logging

See merge request ADLR/megatron-lm!222

Typo fix.

See merge request ADLR/megatron-lm!221

Teach merge_mp_partitions how to write out a pipelined model.

See merge request ADLR/megatron-lm!218

license text for autoaugmentation

See merge request ADLR/megatron-lm!220

Rework handling of older checkpoint's attention weight/bias ordering.

See merge request ADLR/megatron-lm!219

Move rearranging query_key_value and key_value values in old checkpoints to when the checkpoint is loaded instead of runtime..

added init method std to gpt3 example

See merge request ADLR/megatron-lm!217

added grad and params norm to logging and tensorboard

See merge request ADLR/megatron-lm!214

vit model does not get imported automatically anymore

See merge request ADLR/megatron-lm!216

call helpers makefile every run so we recompile if the code has changed

See merge request ADLR/megatron-lm!215

Vision transformer

See merge request ADLR/megatron-lm!204

attention_mask_func cleanup

See merge request ADLR/megatron-lm!212

Fixing merge_mp_partitions

See merge request ADLR/megatron-lm!213