Unverified Commit 131f32a0 authored by Yuanheng Zhao's avatar Yuanheng Zhao Committed by GitHub
Browse files

[fix] fix grok-1 example typo (#5506)

parent 0688d92e
...@@ -35,7 +35,7 @@ Command example: ...@@ -35,7 +35,7 @@ Command example:
./run_inference_slow.sh <MODEL_NAME_OR_PATH> ./run_inference_slow.sh <MODEL_NAME_OR_PATH>
``` ```
`MODEL_NAME_OR_PATH` can be a model name from Hugging Face model hub or a local path to PyTorch-version model checkpoints. We provided weights on model hub, named `hpcaitech/grok-1`. And you could also download the weights in advance using `git`: `MODEL_NAME_OR_PATH` can be a model name from Hugging Face model hub or a local path to PyTorch-version model checkpoints. We have provided pytorch-version checkpoint on [HuggingFace model hub](https://huggingface.co/hpcai-tech/grok-1), named `hpcai-tech/grok-1`. And you could also download the weights in advance using `git`:
```bash ```bash
git lfs install git lfs install
git clone https://huggingface.co/hpcai-tech/grok-1 git clone https://huggingface.co/hpcai-tech/grok-1
......
#!/usr/bin/env bash #!/usr/bin/env bash
PRETRAINED=${1:-"hpcaitech/grok-1"} PRETRAINED=${1:-"hpcai-tech/grok-1"}
torchrun --standalone --nproc_per_node 8 inference_tp.py --pretrained "$PRETRAINED" \ torchrun --standalone --nproc_per_node 8 inference_tp.py --pretrained "$PRETRAINED" \
--max_new_tokens 100 \ --max_new_tokens 100 \
......
#!/usr/bin/env bash #!/usr/bin/env bash
PRETRAINED=${1:-"hpcaitech/grok-1"} PRETRAINED=${1:-"hpcai-tech/grok-1"}
python3 inference.py --pretrained "$PRETRAINED" \ python3 inference.py --pretrained "$PRETRAINED" \
--max_new_tokens 100 \ --max_new_tokens 100 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment