Unverified Commit bebfe55b authored by petrpechman's avatar petrpechman Committed by GitHub
Browse files

[Doc] Fix example of eagle3 (#34960)


Signed-off-by: default avatarPetr Pechman <petr.pechman@firma.seznam.cz>
Co-authored-by: default avatarPetr Pechman <petr.pechman@firma.seznam.cz>
parent 820d7815
......@@ -44,7 +44,7 @@ llm = LLM(
"model": "RedHatAI/Llama-3.1-8B-Instruct-speculator.eagle3",
"draft_tensor_parallel_size": 2,
"num_speculative_tokens": 2,
"method": "eagle",
"method": "eagle3",
},
)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment