Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
838b4509
Commit
838b4509
authored
Feb 12, 2026
by
zhuwenwen
Browse files
update chat template of dsv32
parent
b5ea93d4
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
12 additions
and
5 deletions
+12
-5
vllm/renderers/hf.py
vllm/renderers/hf.py
+12
-5
No files found.
vllm/renderers/hf.py
View file @
838b4509
...
...
@@ -35,6 +35,7 @@ from vllm.transformers_utils.processor import cached_get_processor
from
vllm.utils.func_utils
import
supports_kw
from
.protocol
import
RendererLike
import
vllm.envs
as
envs
logger
=
init_logger
(
__name__
)
...
...
@@ -448,11 +449,17 @@ def safe_apply_chat_template(
model_config
=
model_config
,
)
if
chat_template
is
None
:
raise
ChatTemplateResolutionError
(
"As of transformers v4.44, default chat template is no longer "
"allowed, so you must provide a chat template if the tokenizer "
"does not define one."
)
if
envs
.
VLLM_USE_V32_ENCODE
:
from
vllm.entrypoints.encoding_dsv32
import
encode_messages
encode_config
=
dict
(
thinking_mode
=
"thinking"
,
drop_thinking
=
True
,
add_default_bos_token
=
True
)
prompt
=
encode_messages
(
conversation
,
**
encode_config
)
return
tokenizer
.
encode
(
prompt
)
else
:
raise
ChatTemplateResolutionError
(
"As of transformers v4.44, default chat template is no longer "
"allowed, so you must provide a chat template if the tokenizer "
"does not define one."
)
resolved_kwargs
=
resolve_chat_template_kwargs
(
tokenizer
=
tokenizer
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment