Skip to content

GitLab

Unverified Commit 1b0b065e authored by wonjun Jang's avatar wonjun Jang Committed by GitHub
Browse files

[BugFix] Handle missing sep_token for Qwen3-Reranker in Score API (#19522) 


Signed-off-by: default avatarstrutive07 <strutive07@gmail.com>
parent d5bdf899
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
vllm/entrypoints/openai/serving_score.py
View file @ 1b0b065e
...@@ -174,8 +174,8 @@ class ServingScores(OpenAIServing): ...@@ -174,8 +174,8 @@ class ServingScores(OpenAIServing):
for t1, t2 in input_pairs)) for t1, t2 in input_pairs))
for prompt_inputs, (t1, t2) in zip(tokenized_prompts, input_pairs): for prompt_inputs, (t1, t2) in zip(tokenized_prompts, input_pairs):
sep_token = tokenizer.sep_token if tokenizer.sep_token else ''
request_prompt = f"{t1}{tokenizer.sep_token}{t2}" request_prompt = f"{t1}{sep_token}{t2}"
input_ids = prompt_inputs["input_ids"] input_ids = prompt_inputs["input_ids"]
text_token_prompt = \ text_token_prompt = \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment