README.md 4.51 KB
Newer Older
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
1
# Uni-Fold
2

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
3
## 论文
Rayyyyy's avatar
Rayyyyy committed
4
5
`Uni-Fold: An Open-Source Platform for Developing Protein Folding Models beyond AlphaFold`
- https://www.biorxiv.org/content/biorxiv/early/2022/08/06/2022.08.04.502811.full.pdf
zhangqha's avatar
zhangqha committed
6
7

## 模型结构
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
8
模型核心是一个基于Transformer架构的神经网络,包括两个主要组件:Sequence to Sequence Model和Structure Model,这两个组件通过迭代训练进行优化,以提高其预测准确性。
zhangqha's avatar
zhangqha committed
9

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
10
![img](./alphafold2.png)
zhangqha's avatar
zhangqha committed
11

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
12
13
## 算法原理
通过从蛋白质序列和结构数据中提取信息,使用神经网络模型来预测蛋白质三维结构。
zhangqha's avatar
zhangqha committed
14

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
15
![img](./alphafold2_1.png)
zhangqha's avatar
zhangqha committed
16

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
17
## 环境配置
zhangqha's avatar
zhangqha committed
18
提供[光源](https://www.sourcefind.cn/#/service-details)拉取的训练的docker镜像:
19

zhangqha's avatar
zhangqha committed
20
```
yuhai's avatar
yuhai committed
21
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:unifold-torch2.1.0-dtk24.04.2-ubuntu20.04-py310
22

yuhai's avatar
yuhai committed
23
docker run -it --network=host  -v <unifold代码路径>:<容器内路径> --shm-size=32G --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video  -v /opt/hyhal:/opt/hyhal:ro -v /opt/dtk-24.04.2-runtime/:/opt/dtk/:ro  --name <镜像名称> <上面获得的镜像ID> bash
Rayyyyy's avatar
Rayyyyy committed
24

yuhai's avatar
yuhai committed
25
cd /root/Uni-Fold
zhangqha's avatar
zhangqha committed
26
```
27

yuhai's avatar
yuhai committed
28
进行homosearch需要挂载AF2数据集至容器内`/alphafold`,若只为测试,本镜像无需挂载AF2数据集。
yuhai's avatar
yuhai committed
29
因为本镜像在昆山K100_AI的eco卡节点测试,dtk24.04.2不能正常使用,测试时挂载dtk-24.04.2-runtime至/opt/dtk。若确认本节点dtk24.04.2能正常使用可以选择不挂载,并修改/root目录下的/env.sh及Uni-Fold目录中的/opt/dtk为/opt/dtk-24.04.2
yuhai's avatar
yuhai committed
30

yuhai's avatar
yuhai committed
31
32
33
34
35
镜像版本依赖:
* DTK驱动:dtk24.04.2
* Pytorch: 2.1.0
* unifold: 2.2.0
* unicore: 0.0.1
yuhai's avatar
yuhai committed
36
* python: 3.10
37

yuhai's avatar
yuhai committed
38
39
40
测试目录:
`/root/Uni-Fold`

yuhai's avatar
yuhai committed
41
安装requirement.txt中的工具,镜像中已经安装好,加载方式:
42

yuhai's avatar
yuhai committed
43
44
```
source /root/env.sh
zhangqha's avatar
zhangqha committed
45
```
Rayyyyy's avatar
Rayyyyy committed
46

yuhai's avatar
yuhai committed
47
48
若报错`rm: cannot remove 'software': No such file or directory`等不必理会,其中的rm命令只是希望删除两个空文件夹。

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
49
## 数据集
Rayyyyy's avatar
Rayyyyy committed
50
推荐使用[AlphaFold2](http://113.200.138.88:18080/aidatasets/project-dependency/alphafold)中的开源数据集,包括BFD、MGnify、PDB70、Uniclust、Uniref90等,数据集大小约2.62TB。数据集格式如下:
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
51
```
Rayyyyy's avatar
Rayyyyy committed
52
53
$DOWNLOAD_DIR/
    bfd/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
54
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_hhm.ffindex
Rayyyyy's avatar
Rayyyyy committed
55
56
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_hhm.ffdata
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_cs219.ffindex
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
57
        ...
Rayyyyy's avatar
Rayyyyy committed
58
    mgnify/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
59
        mgy_clusters_2022_05.fa
Rayyyyy's avatar
Rayyyyy committed
60
    params/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
61
62
63
64
        params_model_1.npz
        params_model_2.npz
        params_model_3.npz
        ...
Rayyyyy's avatar
Rayyyyy committed
65
    pdb70/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
66
67
68
69
        pdb_filter.dat
        pdb70_hhm.ffindex
        pdb70_hhm.ffdata
        ...
Rayyyyy's avatar
Rayyyyy committed
70
    pdb_mmcif/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
71
72
73
74
75
76
        mmcif_files/
            100d.cif
            101d.cif
            101m.cif
            ...
        obsolete.dat
Rayyyyy's avatar
Rayyyyy committed
77
    pdb_seqres/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
78
        pdb_seqres.txt
Rayyyyy's avatar
Rayyyyy committed
79
    small_bfd/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
80
        bfd-first_non_consensus_sequences.fasta
Rayyyyy's avatar
Rayyyyy committed
81
    uniref30/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
82
83
84
85
        UniRef30_2021_03_hhm.ffindex
        UniRef30_2021_03_hhm.ffdata
        UniRef30_2021_03_cs219.ffindex
        ...
Rayyyyy's avatar
Rayyyyy committed
86
    uniprot/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
87
        uniprot.fasta
Rayyyyy's avatar
Rayyyyy committed
88
    uniref90/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
89
90
        uniref90.fasta
```
Rayyyyy's avatar
Rayyyyy committed
91

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
92
此处提供了一个脚本download_all_data.sh用于下载使用的数据集和模型文件:
Rayyyyy's avatar
Rayyyyy committed
93

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
94
95
96
97
98
```
bash scripts/download/download_all_data.sh /path/to/database/directory
```

## 推理
zhangqha's avatar
zhangqha committed
99
### 安装
100
#### 安装Uni-Core-main(如使用镜像,则无需再次安装)
zhangqha's avatar
zhangqha committed
101
```
zhangqha's avatar
zhangqha committed
102
cd Uni-Core-main
103

zhangqha's avatar
zhangqha committed
104
python3 setup.py install
zhangqha's avatar
zhangqha committed
105
```
Rayyyyy's avatar
Rayyyyy committed
106

107
#### 安装Uni-Fold-main(如使用镜像,则无需再次安装)
zhangqha's avatar
zhangqha committed
108
```
zhangqha's avatar
zhangqha committed
109
pip install -e .
zhangqha's avatar
zhangqha committed
110
```
Rayyyyy's avatar
Rayyyyy committed
111

dcuai's avatar
dcuai committed
112
### 多卡测试
yuhai's avatar
yuhai committed
113
114
115
116

如果没有挂载AF2数据集,会出现多体、单体测试脚本运行homosearch中报错`ValueError: Could not find hmmsearch database /alphafold/pdb_seqres/pdb_seqres.txt`并停止搜索、直接进行推理的情况,由于单本镜像内置了部分序列的搜索结果,因此可以无视此报错进行正常推理。
内置搜索结果的目录见`/root/Uni-Fold/data`,其中有H1036、H1072、T1024的搜索结果,若要选择其他序列进行推理,请挂载AF2数据集并进行homosearch(非常耗时)。

zhangqha's avatar
zhangqha committed
117
#### 多聚体参考脚本,需要根据实际情况修改路径配置
zhangqha's avatar
zhangqha committed
118
```
yuhai's avatar
yuhai committed
119
bash run_multimer.sh
zhangqha's avatar
zhangqha committed
120
```
Rayyyyy's avatar
Rayyyyy committed
121

zhangqha's avatar
zhangqha committed
122
#### 单聚体参考脚本,需要根据实际情况修改路径配置
zhangqha's avatar
zhangqha committed
123
```
yuhai's avatar
yuhai committed
124
bash run_monomer.sh
zhangqha's avatar
zhangqha committed
125
```
Rayyyyy's avatar
Rayyyyy committed
126

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
127
## result
zhangqha's avatar
zhangqha committed
128
![img](./result_pdb.png)
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
129

dcuai's avatar
dcuai committed
130
### 精度
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
131
132


Rayyyyy's avatar
Rayyyyy committed
133
## 应用场景
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
134
### 算法类别
dcuai's avatar
dcuai committed
135
蛋白质结构预测
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
136
137
138
139

### 热点应用行业
医疗,科研,教育

Rayyyyy's avatar
Rayyyyy committed
140
141
## 源码仓库及问题反馈
- https://developer.hpccube.com/codes/modelzoo/uni-fold
zhangqha's avatar
zhangqha committed
142

dcuai's avatar
dcuai committed
143
## 参考资料
Rayyyyy's avatar
Rayyyyy committed
144
- https://github.com/dptech-corp/Uni-Fold