Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
e7391949
Unverified
Commit
e7391949
authored
Dec 10, 2024
by
Russell Bryant
Committed by
GitHub
Dec 10, 2024
Browse files
[Core] Update to outlines >= 0.1.8 (#10576)
Signed-off-by:
Russell Bryant
<
rbryant@redhat.com
>
parent
250ee65d
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
requirements-common.txt
requirements-common.txt
+1
-1
vllm/model_executor/guided_decoding/outlines_logits_processors.py
...el_executor/guided_decoding/outlines_logits_processors.py
+1
-1
No files found.
requirements-common.txt
View file @
e7391949
...
...
@@ -18,7 +18,7 @@ prometheus_client >= 0.18.0
prometheus-fastapi-instrumentator >= 7.0.0
tiktoken >= 0.6.0 # Required for DBRX tokenizer
lm-format-enforcer >= 0.10.9, < 0.11
outlines >= 0.
0.43, < 0.1
outlines >= 0.
1.8
xgrammar >= 0.1.6; platform_machine == "x86_64"
typing_extensions >= 4.10
filelock >= 3.16.1 # need to contain https://github.com/tox-dev/filelock/pull/317
...
...
vllm/model_executor/guided_decoding/outlines_logits_processors.py
View file @
e7391949
...
...
@@ -99,7 +99,7 @@ class RegexLogitsProcessor(BaseLogitsProcessor):
def
_get_guide
(
cls
,
regex_string
:
str
,
tokenizer
:
PreTrainedTokenizerBase
)
->
Guide
:
tokenizer
=
_adapt_tokenizer
(
tokenizer
)
return
RegexGuide
(
regex_string
,
tokenizer
)
return
RegexGuide
.
from_regex
(
regex_string
,
tokenizer
)
def
__init__
(
self
,
regex_string
:
str
,
tokenizer
:
PreTrainedTokenizerBase
):
"""Compile the FSM that drives the regex-structured generation.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment