Skip to content

GitLab

Commit 55e2c496 authored by wangkx1's avatar wangkx1
Browse files

Update README.md

parent 54b7230f
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 4 deletions
README.md
View file @ 55e2c496
...@@ -15,8 +15,8 @@ Text Generation Inference（TGI）是一个用 Rust 和 Python 编写的框架 ...@@ -15,8 +15,8 @@ Text Generation Inference（TGI）是一个用 Rust 和 Python 编写的框架
## 环境要求 ## 环境要求
+ Python 3.10 + Python 3.10
+ DTK 24.04.2 + DTK 24.04.3
+ torch 2.1.0 + torch 2.3.0
### 使用源码编译方式安装 ### 使用源码编译方式安装
...@@ -48,9 +48,9 @@ cd text-generation-inference ...@@ -48,9 +48,9 @@ cd text-generation-inference
pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple
pip install -r pre_requirements.txt pip install -r pre_requirements.txt
#安装exllama #安装rocm-server
cd server cd server
make install-rocm #安装exllama kernels make install-rocm
cd .. #回到项目根目录 cd .. #回到项目根目录
source $HOME/.cargo/env source $HOME/.cargo/env
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment