Unverified Commit 4dad72f0 authored by Russell Bryant's avatar Russell Bryant Committed by GitHub
Browse files

[Misc] Correct an outdated comment. (#24765)


Signed-off-by: default avatarRussell Bryant <rbryant@redhat.com>
parent 59d7ffc1
...@@ -260,10 +260,10 @@ class Processor: ...@@ -260,10 +260,10 @@ class Processor:
else: else:
# NOTE: engine_level_backend must be "auto" here, because we have # NOTE: engine_level_backend must be "auto" here, because we have
# checked supported_backends above. # checked supported_backends above.
# "auto" is an opt-in to opinionated behavior where we try to # In this mode, we set opinionated defaults based on what we think
# choose a backend based on request contents. This is not the # will satisfy the most use cases without having to worry about
# default as it is less predictable and subject to change # this setting. We include fallback behavior here, but not with any
# between releases as feature support changes. # other setting where a specific backend was specified.
try: try:
validate_xgrammar_grammar(params) validate_xgrammar_grammar(params)
params.guided_decoding.backend = "xgrammar" params.guided_decoding.backend = "xgrammar"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment