"vllm/vscode:/vscode.git/clone" did not exist on "0ee3b7fc3d230f3243e6eb2d5ef24539faa8b893"
Unverified Commit 1fb0495a authored by FredericOdermatt's avatar FredericOdermatt Committed by GitHub
Browse files

[FIX] guidance: use max(vocab_size, len(tokenizer)) for n_vocab (#33509)


Signed-off-by: default avatarFrederic Odermatt <frederic.odermatt@44ai.ch>
parent 85ee1d96
...@@ -93,7 +93,7 @@ class GuidanceBackend(StructuredOutputBackend): ...@@ -93,7 +93,7 @@ class GuidanceBackend(StructuredOutputBackend):
) )
self.ll_tokenizer = llguidance_hf.from_tokenizer( self.ll_tokenizer = llguidance_hf.from_tokenizer(
self.tokenizer, self.vocab_size self.tokenizer, max(self.vocab_size, len(self.tokenizer))
) )
def compile_grammar( def compile_grammar(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment