Unverified Commit ee179c2a authored by wang jiahao's avatar wang jiahao Committed by GitHub
Browse files

Update balance-serve.md

parent a41d2163
...@@ -40,7 +40,11 @@ release: bump version v0.2.4 by @Atream @Azure-Tang @ErvinXie @qiyuxinlin @ovow ...@@ -40,7 +40,11 @@ release: bump version v0.2.4 by @Atream @Azure-Tang @ErvinXie @qiyuxinlin @ovow
## Installation Guide ## Installation Guide
⚠️ Please note that installing this project will replace flashinfer in your environment. It is strongly recommended to create a new conda environment!!!
⚠️ Please note that installing this project will replace flashinfer in your environment. It is strongly recommended to create a new conda environment!!!
⚠️ Please note that installing this project will replace flashinfer in your environment. It is strongly recommended to create a new conda environment!!!
### 1. Set Up Conda Environment ### 1. Set Up Conda Environment
We recommend using Miniconda3/Anaconda3 for environment management: We recommend using Miniconda3/Anaconda3 for environment management:
...@@ -125,4 +129,4 @@ curl -X POST http://localhost:10002/v1/chat/completions \ ...@@ -125,4 +129,4 @@ curl -X POST http://localhost:10002/v1/chat/completions \
"top_p": 1.0, "top_p": 1.0,
"stream": true "stream": true
}' }'
``` ```
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment