added llama_tencentpretrain_pytorch

ea2d13c2 · zhaoying1 · ea2d13c2 · ea2d13c2 · ea2d13c2 · ea2d13c2
Commit ea2d13c2 authored Sep 07, 2023 by zhaoying1
20 changed files
--- a/scripts/generate_seq2seq_deepspeed.py
+++ b/scripts/generate_seq2seq_deepspeed.py
--- a/scripts/generate_talk2face.py
+++ b/scripts/generate_talk2face.py
--- a/scripts/generated_sentence.txt
+++ b/scripts/generated_sentence.txt
--- a/scripts/prepare_s2t_data_manifest.py
+++ b/scripts/prepare_s2t_data_manifest.py
--- a/scripts/run_lgb.py
+++ b/scripts/run_lgb.py
--- a/scripts/run_lgb_cv_bayesopt.py
+++ b/scripts/run_lgb_cv_bayesopt.py
--- a/scripts/topn_words_dep.py
+++ b/scripts/topn_words_dep.py
--- a/scripts/topn_words_indep.py
+++ b/scripts/topn_words_indep.py
--- a/slurm_scripts/run-13b-pretrain-single.sh
+++ b/slurm_scripts/run-13b-pretrain-single.sh
--- a/slurm_scripts/run-13b-pretrain.sh
+++ b/slurm_scripts/run-13b-pretrain.sh
--- a/slurm_scripts/run-13b-single.sh
+++ b/slurm_scripts/run-13b-single.sh
--- a/slurm_scripts/run-13b.sh
+++ b/slurm_scripts/run-13b.sh
--- a/slurm_scripts/run-ift.sh
+++ b/slurm_scripts/run-ift.sh
--- a/slurm_scripts/run-pt.sh
+++ b/slurm_scripts/run-pt.sh
--- a/tencentpretrain/__init__.py
+++ b/tencentpretrain/__init__.py
--- a/tencentpretrain/decoders/__init__.py
+++ b/tencentpretrain/decoders/__init__.py
--- a/tencentpretrain/decoders/transformer_decoder.py
+++ b/tencentpretrain/decoders/transformer_decoder.py
--- a/tencentpretrain/embeddings/__init__.py
+++ b/tencentpretrain/embeddings/__init__.py
--- a/tencentpretrain/embeddings/dual_embedding.py
+++ b/tencentpretrain/embeddings/dual_embedding.py
--- a/tencentpretrain/embeddings/embedding.py
+++ b/tencentpretrain/embeddings/embedding.py