"vscode:/vscode.git/clone" did not exist on "c478e20a9caab0ab43a40af1a7e975c3ce29d46d"
Defensively copy `sampling_params` (#2881)
If the SamplingParams object passed to LLMEngine.add_request() is mutated after it returns, it could affect the async sampling process for that request. Suggested by @Yard1 https://github.com/vllm-project/vllm/pull/2514#discussion_r1490106059
Showing
Please register or sign in to comment