Skip to content

GitLab

Unverified Commit 3dd35914 authored by Nicolò Lucchesi's avatar Nicolò Lucchesi Committed by GitHub
Browse files

[Docs] Update EAGLE example (#20375) 


Signed-off-by: default avatarNickLucche <nlucches@redhat.com>
parent 657f2f30
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
docs/features/spec_decode.md
View file @ 3dd35914
...@@ -201,6 +201,7 @@ an [EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency)](https ...@@ -201,6 +201,7 @@ an [EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency)](https
speculative_config={ speculative_config={
"model": "yuhuili/EAGLE-LLaMA3-Instruct-8B", "model": "yuhuili/EAGLE-LLaMA3-Instruct-8B",
"draft_tensor_parallel_size": 1, "draft_tensor_parallel_size": 1,
"num_speculative_tokens": 2,
}, },
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment