Unverified Commit 131f32a0 authored by Yuanheng Zhao's avatar Yuanheng Zhao Committed by GitHub
Browse files

[fix] fix grok-1 example typo (#5506)

parent 0688d92e
......@@ -35,7 +35,7 @@ Command example:
./run_inference_slow.sh <MODEL_NAME_OR_PATH>
```
`MODEL_NAME_OR_PATH` can be a model name from Hugging Face model hub or a local path to PyTorch-version model checkpoints. We provided weights on model hub, named `hpcaitech/grok-1`. And you could also download the weights in advance using `git`:
`MODEL_NAME_OR_PATH` can be a model name from Hugging Face model hub or a local path to PyTorch-version model checkpoints. We have provided pytorch-version checkpoint on [HuggingFace model hub](https://huggingface.co/hpcai-tech/grok-1), named `hpcai-tech/grok-1`. And you could also download the weights in advance using `git`:
```bash
git lfs install
git clone https://huggingface.co/hpcai-tech/grok-1
......
#!/usr/bin/env bash
PRETRAINED=${1:-"hpcaitech/grok-1"}
PRETRAINED=${1:-"hpcai-tech/grok-1"}
torchrun --standalone --nproc_per_node 8 inference_tp.py --pretrained "$PRETRAINED" \
--max_new_tokens 100 \
......
#!/usr/bin/env bash
PRETRAINED=${1:-"hpcaitech/grok-1"}
PRETRAINED=${1:-"hpcai-tech/grok-1"}
python3 inference.py --pretrained "$PRETRAINED" \
--max_new_tokens 100 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment