Unverified Commit 6b859e7d authored by Chayenne's avatar Chayenne Committed by GitHub
Browse files

Docs: add special warning to engine docs (#3979)

parent 930da877
...@@ -18,10 +18,13 @@ ...@@ -18,10 +18,13 @@
"- Non-streaming asynchronous generation\n", "- Non-streaming asynchronous generation\n",
"- Streaming asynchronous generation\n", "- Streaming asynchronous generation\n",
"\n", "\n",
"Additionally, you can easily build a custom server on top of the SGLang offline engine. A detailed example working in a python script can be found in [custom_server](https://github.com/sgl-project/sglang/blob/main/examples/runtime/engine/custom_server.py).\n",
"\n", "\n",
"<span style=\"color:red\">**To launch the offline engine in your python scripts,** `__main__` **condition is necessary, since we use** `spawn` **mode to create subprocesses. Please refer to this** [simple example](https://github.com/sgl-project/sglang/blob/main/examples/runtime/engine/launch_engine.py) **for more details.**</span>\n", "## SPECIAL WARNING!!!!\n",
"\n", "\n",
"Additionally, you can easily build a custom server on top of the SGLang offline engine. A detailed example working in a python script can be found in [custom_server](https://github.com/sgl-project/sglang/blob/main/examples/runtime/engine/custom_server.py)." "**To launch the offline engine in your python scripts,** `__main__` **condition is necessary, since we use** `spawn` **mode to create subprocesses. Please refer to this simple example**:\n",
"\n",
"https://github.com/sgl-project/sglang/blob/main/examples/runtime/engine/launch_engine.py"
] ]
}, },
{ {
......
make clean make clean
make html make html
python3 -m http.server --d _build/html python3 -m http.server --d _build/html 8003
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment