Skip to content

GitLab

Unverified Commit f8fb4ce9 authored by Ikko Eltociear Ashimine's avatar Ikko Eltociear Ashimine Committed by GitHub
Browse files

chore: update README.md (#1580)

parent 5d0ba403
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ f8fb4ce9
...@@ -336,7 +336,7 @@ GLOO_SOCKET_IFNAME=eth0 python3 -m sglang.launch_server --model-path meta-llama/ ...@@ -336,7 +336,7 @@ GLOO_SOCKET_IFNAME=eth0 python3 -m sglang.launch_server --model-path meta-llama/
The frontend language can be used with local models or API models. It is an alternative to the OpenAI API. You may found it easier to use for complex prompting workflow. The frontend language can be used with local models or API models. It is an alternative to the OpenAI API. You may found it easier to use for complex prompting workflow.
### Quick Start ### Quick Start
The example below shows how to use sglang to answer a mulit-turn question. The example below shows how to use sglang to answer a multi-turn question.
#### Using Local Models #### Using Local Models
First, launch a server with First, launch a server with
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment