Skip to content

GitLab

Unverified Commit a2e95308 authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

ggml -> gguf in readme

parent 35bdecd3
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
README.md
View file @ a2e95308
...@@ -141,11 +141,11 @@ python main.py \ ...@@ -141,11 +141,11 @@ python main.py \
--tasks hellaswag --tasks hellaswag
``` ```
GGML quantized models can be loaded by using `llama-cpp-python` server: GGUF or GGML quantized models can be loaded by using `llama-cpp-python` server:
```bash ```bash
python main.py \ python main.py \
--model ggml \ --model gguf \
--model_args base_url=http://localhost:8000 \ --model_args base_url=http://localhost:8000 \
--tasks hellaswag --tasks hellaswag
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment