Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
838b4509
Commit
838b4509
authored
Feb 12, 2026
by
zhuwenwen
Browse files
update chat template of dsv32
parent
b5ea93d4
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
12 additions
and
5 deletions
+12
-5
vllm/renderers/hf.py
vllm/renderers/hf.py
+12
-5
No files found.
vllm/renderers/hf.py
View file @
838b4509
...
@@ -35,6 +35,7 @@ from vllm.transformers_utils.processor import cached_get_processor
...
@@ -35,6 +35,7 @@ from vllm.transformers_utils.processor import cached_get_processor
from
vllm.utils.func_utils
import
supports_kw
from
vllm.utils.func_utils
import
supports_kw
from
.protocol
import
RendererLike
from
.protocol
import
RendererLike
import
vllm.envs
as
envs
logger
=
init_logger
(
__name__
)
logger
=
init_logger
(
__name__
)
...
@@ -448,6 +449,12 @@ def safe_apply_chat_template(
...
@@ -448,6 +449,12 @@ def safe_apply_chat_template(
model_config
=
model_config
,
model_config
=
model_config
,
)
)
if
chat_template
is
None
:
if
chat_template
is
None
:
if
envs
.
VLLM_USE_V32_ENCODE
:
from
vllm.entrypoints.encoding_dsv32
import
encode_messages
encode_config
=
dict
(
thinking_mode
=
"thinking"
,
drop_thinking
=
True
,
add_default_bos_token
=
True
)
prompt
=
encode_messages
(
conversation
,
**
encode_config
)
return
tokenizer
.
encode
(
prompt
)
else
:
raise
ChatTemplateResolutionError
(
raise
ChatTemplateResolutionError
(
"As of transformers v4.44, default chat template is no longer "
"As of transformers v4.44, default chat template is no longer "
"allowed, so you must provide a chat template if the tokenizer "
"allowed, so you must provide a chat template if the tokenizer "
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment