README.md 1.15 KB
Newer Older
gaoqiong's avatar
gaoqiong committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
# <div align="center"><strong>AutoAWQ_kernel</strong></div>
## 简介
AutoAWQ_kernel是一个从AutoAWQ分离出来的一个组件,以减少编译时间
## 安装

### 使用源码编译方式安装

#### 编译环境准备
下载光源的镜像,起dcoker

```
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310

# <Image ID>用上面拉取docker镜像的ID替换
# <Host Path>主机端路径
# <Container Path>容器映射路径
docker run -it --name baichuan --shm-size=1024G -v /opt/hyhal:/opt/hyhal:ro --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v <Host Path>:<Container Path> <Image ID> /bin/bash
```
注:
1、docker启动  -v /opt/hyhal:/opt/hyhal  这个变量不能少             

#### 源码编译安装
- 代码下载
根据不同的需求下载不同的分支
- 提供2种源码编译方式(进入AutoAWQ目录):
```
1. 源码编译安装
gaoqiong's avatar
gaoqiong committed
28
pip3 install e .
gaoqiong's avatar
gaoqiong committed
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51

2. 编译成whl包安装
# 安装wheel 
python3 setup.py bdist_wheel
cd dist && pip3 install autoawq*
```

















Casper's avatar
Casper committed
52
53
54



Ilyas Moutawwakil's avatar
Ilyas Moutawwakil committed
55

Casper's avatar
Casper committed
56
57
58



Ilyas Moutawwakil's avatar
Ilyas Moutawwakil committed
59

Casper's avatar
Casper committed
60

Ilyas Moutawwakil's avatar
Ilyas Moutawwakil committed
61
62
63



Casper's avatar
Casper committed
64

Ilyas Moutawwakil's avatar
Ilyas Moutawwakil committed
65