-
Thomas Parnell authored
[Bugfix] Better error message for MLPSpeculator when `num_speculative_tokens` is set too high (#5894) Signed-off-by:Thomas Parnell <tpa@zurich.ibm.com>
ec1ad004
[Bugfix] Better error message for MLPSpeculator when `num_speculative_tokens` is set too high (#5894)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>