"vscode:/vscode.git/clone" did not exist on "390078904c791c7c66c08478ed3d657b42ba7888"
Unverified Commit d1fcb208 authored by Atream's avatar Atream Committed by GitHub
Browse files

Update llama4.md

parent 0774fe4d
......@@ -71,7 +71,7 @@ USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
Make sure you have:
- `--model_path` pointing to a local config directory (not a Hugging Face name).
- `--gguf_path` pointing to quantized `.gguf` weights.
- `--gguf_path` pointing to the folder containing quantized `.gguf` weights.
```bash
python ktransformers/server/main.py \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment