"...resnet50_tensorflow.git" did not exist on "7c16e618ff01c99b2566d6da8f524ce4013882ac"
Defensively copy `sampling_params` (#2881)
If the SamplingParams object passed to LLMEngine.add_request() is mutated after it returns, it could affect the async sampling process for that request. Suggested by @Yard1 https://github.com/vllm-project/vllm/pull/2514#discussion_r1490106059
Showing
Please register or sign in to comment