Unverified Commit a46c43b2 authored by Atream's avatar Atream Committed by GitHub
Browse files

Merge pull request #1099 from kvcache-ai/Atream-patch-3

Update llama4.md
parents 0774fe4d d1fcb208
......@@ -71,7 +71,7 @@ USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
Make sure you have:
- `--model_path` pointing to a local config directory (not a Hugging Face name).
- `--gguf_path` pointing to quantized `.gguf` weights.
- `--gguf_path` pointing to the folder containing quantized `.gguf` weights.
```bash
python ktransformers/server/main.py \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment