-
Sergei Skvortsov authored
[Bugfix] Fix error with penalties when speculative decoding and structural output are enabled (#26586) Signed-off-by:southfreebird <yvorott@gmail.com>
f6fdacd8
[Bugfix] Fix error with penalties when speculative decoding and structural output are enabled (#26586)
Signed-off-by: southfreebird <yvorott@gmail.com>