Skip to content

GitLab

Commit 75e3f49b authored by hepj987's avatar hepj987
Browse files

调整格式

parent 56325238
Pipeline #362 canceled with stage
Hide whitespace changes
Inline Side-by-side
Showing with 11 additions and 3 deletions
conver.sh
View file @ 75e3f49b
export PYTHONPATH=/home/megatron-deepspeed_dtk22.10:$PYTHONPATH export PYTHONPATH=/home/megatron-deepspeed_dtk22.10:$PYTHONPATH
CHECKPOINT_PATH=./output-module/gpt2-4tp/global_step200 CHECKPOINT_PATH=./output-module/gpt2-oscar_16B-4tp/global_step1000
python tools/convert_checkpoint/deepspeed_to_megatron.py \ python tools/convert_checkpoint/deepspeed_to_megatron.py \
--input_folder $CHECKPOINT_PATH \ --input_folder $CHECKPOINT_PATH \
--output_folder conver-4tp-model \ --output_folder conver-4tp-model \
......
model.properties 0 → 100644
View file @ 75e3f49b
# 模型名称
modelName=gpt2-PyTorch
# 模型描述
modelDescription=gpt2是一种新的基于单向Transformer的生成式预训练模型,基于PyTorch实现测试
# 应用场景
appScenario=推理，训练，文本生成
# 框架类型
frameType=PyTorch
single-16B.sh
View file @ 75e3f49b
...@@ -10,10 +10,10 @@ RANK=$OMPI_COMM_WORLD_RANK ...@@ -10,10 +10,10 @@ RANK=$OMPI_COMM_WORLD_RANK
WORLD_SIZE=$OMPI_COMM_WORLD_SIZE WORLD_SIZE=$OMPI_COMM_WORLD_SIZE
MODEL_NAME=gpt2-oscar_16B-8tp MODEL_NAME=gpt2-oscar_16B-4tp
DATA_OUTPUT_PATH=./ DATA_OUTPUT_PATH=./
LOGS_PATH=$DATA_OUTPUT_PATH/logs LOGS_PATH=$DATA_OUTPUT_PATH/logs
CHECKPOINT_PATH=output-module/$MODEL_NAME CHECKPOINT_PATH=./output-module/$MODEL_NAME
DATA_PATH="my-gpt2_text_document" DATA_PATH="my-gpt2_text_document"
TENSORBOARD_PATH=output_dir/tensorboard/$MODEL_NAME TENSORBOARD_PATH=output_dir/tensorboard/$MODEL_NAME
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment