"tutorials/models/1_gnn/1_gcn.py" did not exist on "b1e8d95e993cc6f0720af81bb2bcfba23c291bd4"
Commit fbf42263 authored by Lianmin Zheng's avatar Lianmin Zheng
Browse files

Update Readme (#11)

parent 2ccd9fd8
...@@ -36,6 +36,12 @@ pip install -e "python[all]" ...@@ -36,6 +36,12 @@ pip install -e "python[all]"
The example below shows how to use sglang to answer a mulit-turn question. The example below shows how to use sglang to answer a mulit-turn question.
### Using OpenAI Models ### Using OpenAI Models
Set the OpenAI API Key
```
export OPENAI_API_KEY=sk-xxxxxx
```
Then, answer a multi-turn question.
```python ```python
from sglang import function, system, user, assistant, gen, set_default_backend, OpenAI from sglang import function, system, user, assistant, gen, set_default_backend, OpenAI
...@@ -99,7 +105,7 @@ To begin with, import sglang. ...@@ -99,7 +105,7 @@ To begin with, import sglang.
import sglang as sgl import sglang as sgl
``` ```
`sglang` provides some simple primitives such as `gen`, `select`, `fork`. `sglang` provides some simple primitives such as `gen`, `select`, `fork`, `image`.
You can implement your prompt flow in a function decorated by `sgl.function`. You can implement your prompt flow in a function decorated by `sgl.function`.
You can then invoke the function with `run` or `run_batch`. You can then invoke the function with `run` or `run_batch`.
The system will manage the state, chat template, and parallelism for you. The system will manage the state, chat template, and parallelism for you.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment