update to core_v0.9

4b097dee · liangjing · 3aca1415 · 4b097dee · 4b097dee · 4b097dee
Commit 4b097dee authored Oct 29, 2024 by liangjing
20 changed files
--- a/examples/retro/train_retro_2b_distributed.sh
+++ b/examples/retro/train_retro_2b_distributed.sh
--- a/examples/run_simple_mcore_train_loop.py
+++ b/examples/run_simple_mcore_train_loop.py
--- a/examples/t5/README.md
+++ b/examples/t5/README.md
--- a/examples/t5/t5_mcore_train_curve.png
+++ b/examples/t5/t5_mcore_train_curve.png
--- a/examples/pretrain_t5_distributed_with_mp.sh
+++ b/examples/pretrain_t5_distributed_with_mp.sh
--- a/gpt2-merges.txt
+++ b/gpt2-merges.txt
--- a/gpt2-vocab.json
+++ b/gpt2-vocab.json
--- a/images/Achieved_petaFLOPs.png
+++ b/images/Achieved_petaFLOPs.png
--- a/images/cases_april2021.png
+++ b/images/cases_april2021.png
--- a/images/model_table.png
+++ b/images/model_table.png
--- a/images/strong_scaling.png
+++ b/images/strong_scaling.png
--- a/images/weak_scaling.png
+++ b/images/weak_scaling.png
--- a/megatron/core/QuickStart.md
+++ b/megatron/core/QuickStart.md
--- a/megatron/core/README.md
+++ b/megatron/core/README.md
--- a/megatron/core/README_STRAGGLER.md
+++ b/megatron/core/README_STRAGGLER.md
--- a/megatron/core/__init__.py
+++ b/megatron/core/__init__.py
--- a/megatron/core/config_logger.py
+++ b/megatron/core/config_logger.py
--- a/megatron/data/Makefile
+++ b/megatron/data/Makefile
--- a/megatron/mpu/tests/__init__.py
+++ b/megatron/mpu/tests/__init__.py
--- a/megatron/core/datasets/bert_dataset.py
+++ b/megatron/core/datasets/bert_dataset.py