Skip to content

GitLab

"...resnet50_tensorflow.git" did not exist on "73e9d6dd1c4390339ac72e5697b5e68338be65b0"
Commit 82dafb34 authored by baberabb's avatar baberabb
Browse files

nits

parent f45f67e4
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 82dafb34
...@@ -113,7 +113,7 @@ We also support vLLM for faster inference on [supported model types](https://doc ...@@ -113,7 +113,7 @@ We also support vLLM for faster inference on [supported model types](https://doc
```bash ```bash
lm_eval --model vllm \ lm_eval --model vllm \
--model_args pretrained={model_name},tensor_parallel_size={number of GPUs to use},dtype=auto,gpu_memory_utilization=0.8 \ --model_args pretrained={model_name},tensor_parallel_size={GPUs_per_model},dtype=auto,gpu_memory_utilization=0.8,data_parallel={model_replicas} \
--tasks lambada_openai \ --tasks lambada_openai \
--batch_size auto --batch_size auto
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment