Unverified Commit 978a4462 authored by wang.yuqi's avatar wang.yuqi Committed by GitHub
Browse files

[CI Failure] Fix Plugin Tests (2 GPUs) Failure (#40083)


Signed-off-by: default avatarwang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: default avatarMichele Gazzetti <michele.gazzetti1@ibm.com>
parent 1948d0c4
......@@ -97,6 +97,11 @@ class IOProcessorRequest(PoolingBasicRequestMixin, EncodingRequestMixin, Generic
max_total_tokens_param="max_model_len",
)
def to_pooling_params(self):
return PoolingParams(
task=self.task,
)
class IOProcessorResponse(OpenAIBaseModel, Generic[T]):
request_id: str | None = None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment