Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
78818dd1
Unverified
Commit
78818dd1
authored
Sep 15, 2025
by
Michael Yao
Committed by
GitHub
Sep 14, 2025
Browse files
[Docs] Have a try to improve frameworks/streamlit.md (#24841)
Signed-off-by:
windsonsea
<
haifeng.yao@daocloud.io
>
parent
8e5cdcda
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
18 additions
and
20 deletions
+18
-20
docs/deployment/frameworks/streamlit.md
docs/deployment/frameworks/streamlit.md
+18
-20
No files found.
docs/deployment/frameworks/streamlit.md
View file @
78818dd1
...
@@ -6,35 +6,33 @@ It can be quickly integrated with vLLM as a backend API server, enabling powerfu
...
@@ -6,35 +6,33 @@ It can be quickly integrated with vLLM as a backend API server, enabling powerfu
## Prerequisites
## Prerequisites
-
Setup vLLM environment
Set up the vLLM environment by installing all required packages:
## Deploy
-
Start the vLLM server with the supported chat completion model, e.g.
```
bash
```
bash
vllm serve qwen/Qwen1.5-0.5B-Chat
pip
install
vllm streamlit openai
```
```
-
Install streamlit and openai:
## Deploy
```
bash
1.
Start the vLLM server with a supported chat completion model, e.g.
pip
install
streamlit openai
```
-
Use the script:
<gh-file:examples
/
online_serving
/
streamlit_openai_chatbot_webserver.py
>
```bash
vllm serve Qwen/Qwen1.5-0.5B-Chat
```
-
Start the streamlit web UI and start to chat:
1.
Use the script:
<gh-file:examples
/
online_serving
/
streamlit_openai_chatbot_webserver.py
>
```
bash
1.
Start the streamlit web UI and start to chat:
streamlit run streamlit_openai_chatbot_webserver.py
# or specify the VLLM_API_BASE or VLLM_API_KEY
```bash
VLLM_API_BASE
=
"http://vllm-server-host:vllm-server-port/v1"
\
streamlit run streamlit_openai_chatbot_webserver.py
streamlit run streamlit_openai_chatbot_webserver.py
# start with debug mode to view more details
# or specify the VLLM_API_BASE or VLLM_API_KEY
streamlit run streamlit_openai_chatbot_webserver.py
--logger
.level
=
debug
VLLM_API_BASE="http://vllm-server-host:vllm-server-port/v1" \
```
streamlit run streamlit_openai_chatbot_webserver.py
# start with debug mode to view more details
streamlit run streamlit_openai_chatbot_webserver.py --logger.level=debug
```


Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment