[Docs] Update EAGLE example (#20375)

Signed-off-by: NickLucche <nlucches@redhat.com>

[Docs] Update EAGLE example (#20375)
Signed-off-by: NickLucche <nlucches@redhat.com>
3dd35914 · Nicolò Lucchesi · GitHub · 657f2f30 · 3dd35914
Unverified Commit 3dd35914 authored Jul 03, 2025 by Nicolò Lucchesi Committed by GitHub Jul 02, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

docs/features/spec_decode.md docs/features/spec_decode.md +1 -0

No files found.
--- a/docs/features/spec_decode.md
+++ b/docs/features/spec_decode.md
@@ -201,6 +201,7 @@ an [EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency)](https
        speculative_config={
            "model": "yuhuili/EAGLE-LLaMA3-Instruct-8B",
            "draft_tensor_parallel_size": 1,
+            "num_speculative_tokens": 2,
        },
    )