Commit 55e2c496 authored by wangkx1's avatar wangkx1
Browse files

Update README.md

parent 54b7230f
......@@ -15,8 +15,8 @@ Text Generation Inference(TGI)是一个用 Rust 和 Python 编写的框架
## 环境要求
+ Python 3.10
+ DTK 24.04.2
+ torch 2.1.0
+ DTK 24.04.3
+ torch 2.3.0
### 使用源码编译方式安装
......@@ -48,9 +48,9 @@ cd text-generation-inference
pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple
pip install -r pre_requirements.txt
#安装exllama
#安装rocm-server
cd server
make install-rocm #安装exllama kernels
make install-rocm
cd .. #回到项目根目录
source $HOME/.cargo/env
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment