README.md 1.15 KB
Newer Older
gaoqiong's avatar
gaoqiong committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
# <div align="center"><strong>AutoAWQ_kernel</strong></div>
## 简介
AutoAWQ_kernel是一个从AutoAWQ分离出来的一个组件,以减少编译时间
## 安装

### 使用源码编译方式安装

#### 编译环境准备
下载光源的镜像,起dcoker

```
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310

# <Image ID>用上面拉取docker镜像的ID替换
# <Host Path>主机端路径
# <Container Path>容器映射路径
docker run -it --name baichuan --shm-size=1024G -v /opt/hyhal:/opt/hyhal:ro --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v <Host Path>:<Container Path> <Image ID> /bin/bash
```
注:
1、docker启动  -v /opt/hyhal:/opt/hyhal  这个变量不能少             

#### 源码编译安装
- 代码下载
根据不同的需求下载不同的分支
- 提供2种源码编译方式(进入AutoAWQ目录):
```
1. 源码编译安装
pip3 install e.

2. 编译成whl包安装
# 安装wheel 
python3 setup.py bdist_wheel
cd dist && pip3 install autoawq*
```

















Casper's avatar
Casper committed
52
53
54



Ilyas Moutawwakil's avatar
Ilyas Moutawwakil committed
55

Casper's avatar
Casper committed
56
57
58



Ilyas Moutawwakil's avatar
Ilyas Moutawwakil committed
59

Casper's avatar
Casper committed
60

Ilyas Moutawwakil's avatar
Ilyas Moutawwakil committed
61
62
63



Casper's avatar
Casper committed
64

Ilyas Moutawwakil's avatar
Ilyas Moutawwakil committed
65