"vscode:/vscode.git/clone" did not exist on "acaea3bb07883c80b71643ebee1cd08d555797bc"
Defensively copy `sampling_params` (#2881)
If the SamplingParams object passed to LLMEngine.add_request() is mutated after it returns, it could affect the async sampling process for that request. Suggested by @Yard1 https://github.com/vllm-project/vllm/pull/2514#discussion_r1490106059
Showing
Please register or sign in to comment