Skip to content

GitLab

Unverified Commit 33c5ff28 authored by Lei's avatar Lei Committed by GitHub
Browse files

Add lora_path to chat completion (#2438)

parent 5ce9daea
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
python/sglang/srt/openai_api/protocol.py
View file @ 33c5ff28
...@@ -276,6 +276,7 @@ class ChatCompletionRequest(BaseModel): ...@@ -276,6 +276,7 @@ class ChatCompletionRequest(BaseModel):
user: Optional[str] = None user: Optional[str] = None
# Extra parameters for SRT backend only and will be ignored by OpenAI models. # Extra parameters for SRT backend only and will be ignored by OpenAI models.
lora_path: Optional[Union[List[Optional[str]], Optional[str]]] = None
regex: Optional[str] = None regex: Optional[str] = None
min_tokens: int = 0 min_tokens: int = 0
repetition_penalty: float = 1.0 repetition_penalty: float = 1.0
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment