Skip to content

GitLab

Unverified Commit 637de9e8 authored by fsygd's avatar fsygd Committed by GitHub
Browse files

update readme of DeepSeek V3 (#2596)

parent acb34072
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
benchmark/deepseek_v3/README.md
View file @ 637de9e8
...@@ -26,6 +26,8 @@ pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.4/ ...@@ -26,6 +26,8 @@ pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.4/
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3-Base --enable-dp-attention --tp 8 --trust-remote-code python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3-Base --enable-dp-attention --tp 8 --trust-remote-code
``` ```
If you see errors when launching the server, please check if it has finished downloading the weights. It is recommended to download the weights before launching, or to launch multiple times until all the weights have been downloaded.
### Example with OpenAI API ### Example with OpenAI API
```python3 ```python3
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment