Unverified Commit 4970d798 authored by AllentDan's avatar AllentDan Committed by GitHub
Browse files

update doc and requirements.txt (#119)



* update requirements

* update transformers version

* lint

* comments

* lint

* update requirements

* remove setup_requires

---------
Co-authored-by: default avatardongchunyu <dongchunyu@pjlab.org.cn>
parent 8664946d
...@@ -108,6 +108,12 @@ For the deployment of other supported models, such as LLaMA, vicuna, you can fin ...@@ -108,6 +108,12 @@ For the deployment of other supported models, such as LLaMA, vicuna, you can fin
### Inference with PyTorch ### Inference with PyTorch
You have to install deepspeed first before running with PyTorch.
```
pip install deepspeed
```
#### Single GPU #### Single GPU
```shell ```shell
......
...@@ -107,6 +107,12 @@ python3 -m lmdeploy.app {server_ip_addresss}:33337 internlm ...@@ -107,6 +107,12 @@ python3 -m lmdeploy.app {server_ip_addresss}:33337 internlm
### 基于 PyTorch 的推理 ### 基于 PyTorch 的推理
你必须确保环境中有安装 deepspeed:
```
pip install deepspeed
```
#### 单个 GPU #### 单个 GPU
```shell ```shell
......
# Copyright (c) OpenMMLab. All rights reserved.
from lmdeploy.serve.turbomind.chatbot import Chatbot # noqa: F401,F403
...@@ -106,7 +106,6 @@ if __name__ == '__main__': ...@@ -106,7 +106,6 @@ if __name__ == '__main__':
packages=find_packages( packages=find_packages(
exclude=('lmdeploy/serve/turbomind/triton_models', )), exclude=('lmdeploy/serve/turbomind/triton_models', )),
include_package_data=True, include_package_data=True,
setup_requires=parse_requirements('requirements.txt'),
install_requires=parse_requirements('requirements.txt'), install_requires=parse_requirements('requirements.txt'),
classifiers=[ classifiers=[
'Programming Language :: Python :: 3.8', 'Programming Language :: Python :: 3.8',
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment