v1.0.3

71e79847 · chenzk · 71e79847 · 71e79847 · 71e79847 · 71e79847
Commit 71e79847 authored Dec 03, 2024 by chenzk
20 changed files
--- a/examples/mup/assets/scale-across-depth.png
+++ b/examples/mup/assets/scale-across-depth.png
--- a/examples/mup/assets/scale-across-width.png
+++ b/examples/mup/assets/scale-across-width.png
--- a/examples/mup/configs/mup_350m_llama_config.yaml
+++ b/examples/mup/configs/mup_350m_llama_config.yaml
--- a/examples/mup/configs/sp_350m_llama_config.yaml
+++ b/examples/mup/configs/sp_350m_llama_config.yaml
--- a/examples/train_tiny_llama.sh
+++ b/examples/train_tiny_llama.sh
--- a/git-lfs_install.sh
+++ b/git-lfs_install.sh
--- a/icon.png
+++ b/icon.png
--- a/infer.sh
+++ b/infer.sh
--- a/launch.slurm
+++ b/launch.slurm
--- a/model.properties
+++ b/model.properties
--- a/openwebtext-10k.tar.xz
+++ b/openwebtext-10k.tar.xz
--- a/pyproject.toml
+++ b/pyproject.toml
--- a/requirements.txt
+++ b/requirements.txt
--- a/dummy-tokenizer-wordlevel @ ae57c419
+++ b/dummy-tokenizer-wordlevel @ ae57c419
--- a/run_generate.py
+++ b/run_generate.py
--- a/run_train.py
+++ b/run_train.py
--- a/scripts/fix_checkpoint_bad_naming.py
+++ b/scripts/fix_checkpoint_bad_naming.py
--- a/scripts/log_lighteval_to_wandb.py
+++ b/scripts/log_lighteval_to_wandb.py
--- a/smollm1/README.md
+++ b/smollm1/README.md
--- a/smollm1/config_smollm1_135M.yaml
+++ b/smollm1/config_smollm1_135M.yaml