Skip to content

GitLab

Unverified Commit ca2f6b9c authored by Gregory Shtrasberg's avatar Gregory Shtrasberg Committed by GitHub
Browse files

[Bugfix][Model] Attempt to fix eagle in V0. (#18978) 


Signed-off-by: default avatarGregory Shtrasberg <Gregory.Shtrasberg@amd.com>
parent 20133cfe
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/config.py
View file @ ca2f6b9c
...@@ -2595,7 +2595,8 @@ class SpeculativeConfig: ...@@ -2595,7 +2595,8 @@ class SpeculativeConfig:
else: else:
eagle_config = EAGLEConfig( eagle_config = EAGLEConfig(
self.draft_model_config.hf_config, self.draft_model_config.hf_config,
method=self.method) method=self.method,
model_type="eagle")
self.draft_model_config.hf_config = eagle_config self.draft_model_config.hf_config = eagle_config
if (self.num_speculative_tokens is not None if (self.num_speculative_tokens is not None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment