Skip to content

GitLab

Unverified Commit 31eec35b authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

fix doc (#3558)

parent ac963be2
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
docs/backend/speculative_decoding.ipynb
View file @ 31eec35b
...@@ -47,7 +47,7 @@ ...@@ -47,7 +47,7 @@
" \"\"\"\n", " \"\"\"\n",
"python3 -m sglang.launch_server --model meta-llama/Llama-2-7b-chat-hf --speculative-algo EAGLE \\\n", "python3 -m sglang.launch_server --model meta-llama/Llama-2-7b-chat-hf --speculative-algo EAGLE \\\n",
" --speculative-draft lmzheng/sglang-EAGLE-llama2-chat-7B --speculative-num-steps 5 \\\n", " --speculative-draft lmzheng/sglang-EAGLE-llama2-chat-7B --speculative-num-steps 5 \\\n",
" --speculative-eagle-topk 8 --speculative-num-draft-tokens 64 --mem-fraction 0.7 --port=30020\n", " --speculative-eagle-topk 8 --speculative-num-draft-tokens 64 --mem-fraction 0.7 --port=30020 --cuda-graph-max-bs 32\n",
"\"\"\"\n", "\"\"\"\n",
")\n", ")\n",
"\n", "\n",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment