Update README.md

86311c23 · Hailey Schoelkopf · GitHub · 6409fe6c · 86311c23
Unverified Commit 86311c23 authored Dec 12, 2023 by Hailey Schoelkopf Committed by GitHub Dec 12, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

README.md README.md +1 -1

No files found.
--- a/README.md
+++ b/README.md
@@ -133,7 +133,7 @@ We also support vLLM for faster inference on [supported model types](https://doc

 ```bash
 lm_eval --model vllm \
-    --model_args pretrained={model_name},tensor_parallel_size={GPUs_per_model},dtype=auto,gpu_memory_utilization=0.8,data_parallel={model_replicas} \
+    --model_args pretrained={model_name},tensor_parallel_size={GPUs_per_model},dtype=auto,gpu_memory_utilization=0.8,data_parallel_size={model_replicas} \
    --tasks lambada_openai \
    --batch_size auto
 ```