Commit c57c3558 authored by xuxzh1's avatar xuxzh1 🎱
Browse files

update

parent f45a576a
......@@ -81,6 +81,16 @@ cd .. && pip uninstall lmdeploy && python3 setup.py install
[Yi-34B-Chat](https://huggingface.co/01-ai/Yi-34B-Chat)
### 运行前
```bash
#step 1
cd lmdeploy
pip install -r requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple
#step 2
source /opt/dtk/cuda/env.sh
```
### 运行
```shell
lmdeploy chat turbomind ./path_to_yi-34b --tp 4
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment