Skip to content

GitLab

Unverified Commit 21e22b9e authored by Enrique Shockwave's avatar Enrique Shockwave Committed by GitHub
Browse files

Fix LiteLLM kwargs (#817)

parent a50c8a14
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/lang/backend/litellm.py
View file @ 21e22b9e
...@@ -61,7 +61,7 @@ class LiteLLM(BaseBackend): ...@@ -61,7 +61,7 @@ class LiteLLM(BaseBackend):
model=self.model_name, model=self.model_name,
messages=messages, messages=messages,
**self.client_params, **self.client_params,
**sampling_params.to_anthropic_kwargs(), **sampling_params.to_litellm_kwargs(),
) )
comp = ret.choices[0].message.content comp = ret.choices[0].message.content
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment