Unverified Commit 8c13820f authored by cndoit18's avatar cndoit18 Committed by GitHub
Browse files

[Bugfix] Fix task field initialization when PYTHONOPTIMIZE is enabled (#23718)


Signed-off-by: default avatarcndoit18 <cndoit18@outlook.com>
parent 9d30de44
......@@ -199,8 +199,9 @@ class PoolingModelRunner(
pooling_params = seq_group_metadata.pooling_params
assert pooling_params is not None
assert (task := pooling_params.task) is not None, (
"You did not set `task` in the API")
task = pooling_params.task
assert task is not None, "You did not set `task` in the API"
model = cast(VllmModelForPooling, self.model)
to_update = model.pooler.get_pooling_updates(task)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment