Unverified Commit 67e02fa8 authored by Travis Johnson's avatar Travis Johnson Committed by GitHub
Browse files

[Bugfix] use StoreBoolean instead of type=bool for --disable-logprobs-during-spec-decoding (#7665)


Signed-off-by: default avatarTravis Johnson <tsjohnso@us.ibm.com>
parent 43735bf5
......@@ -664,8 +664,10 @@ class EngineArgs:
parser.add_argument(
'--disable-logprobs-during-spec-decoding',
type=bool,
action=StoreBoolean,
default=EngineArgs.disable_logprobs_during_spec_decoding,
nargs="?",
const="True",
help='If set to True, token log probabilities are not returned '
'during speculative decoding. If set to False, log probabilities '
'are returned according to the settings in SamplingParams. If '
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment