Skip to content

GitLab

Unverified Commit e4c4072c authored by Daniel E Marasco's avatar Daniel E Marasco Committed by GitHub
Browse files

[Bugfix] Remove key sorting for `guided_json` parameter in OpenAi compatible Server (#3945)

parent e3539746
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/guided_decoding.py
View file @ e4c4072c
...@@ -91,7 +91,7 @@ def _get_guide_and_mode( ...@@ -91,7 +91,7 @@ def _get_guide_and_mode(
json = request.guided_json json = request.guided_json
if isinstance(json, dict): if isinstance(json, dict):
# turn dict into hashable string # turn dict into hashable string
json = json_dumps(json, sort_keys=True) json = json_dumps(json)
elif isinstance(json, BaseModel): elif isinstance(json, BaseModel):
# use pydantic signature so that different model classes # use pydantic signature so that different model classes
# with the same fields will get hashed the same # with the same fields will get hashed the same
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment