Unverified Commit 77e44728 authored by Bangsheng Tang's avatar Bangsheng Tang Committed by GitHub
Browse files

let draft model follow target model's config_format (#30152)

parent 962d7038
......@@ -337,6 +337,7 @@ class SpeculativeConfig:
enforce_eager=self.target_model_config.enforce_eager,
max_logprobs=self.target_model_config.max_logprobs,
hf_overrides=SpeculativeConfig.hf_config_override,
config_format=self.target_model_config.config_format,
)
# Automatically detect the method
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment