Skip to content

GitLab

"...git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "f3d0bf7589d6e63a691dcbb9d1db538c184fde29"
Unverified Commit bebfe55b authored by petrpechman's avatar petrpechman Committed by GitHub
Browse files

[Doc] Fix example of eagle3 (#34960) 


Signed-off-by: default avatarPetr Pechman <petr.pechman@firma.seznam.cz>
Co-authored-by: default avatarPetr Pechman <petr.pechman@firma.seznam.cz>
parent 820d7815
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
docs/features/speculative_decoding/eagle.md
View file @ bebfe55b
...@@ -44,7 +44,7 @@ llm = LLM( ...@@ -44,7 +44,7 @@ llm = LLM(
"model": "RedHatAI/Llama-3.1-8B-Instruct-speculator.eagle3", "model": "RedHatAI/Llama-3.1-8B-Instruct-speculator.eagle3",
"draft_tensor_parallel_size": 2, "draft_tensor_parallel_size": 2,
"num_speculative_tokens": 2, "num_speculative_tokens": 2,
"method": "eagle", "method": "eagle3",
}, },
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment