README.md 4.26 KB
Newer Older
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
1
# Uni-Fold
2

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
3
## 论文
Rayyyyy's avatar
Rayyyyy committed
4
5
`Uni-Fold: An Open-Source Platform for Developing Protein Folding Models beyond AlphaFold`
- https://www.biorxiv.org/content/biorxiv/early/2022/08/06/2022.08.04.502811.full.pdf
zhangqha's avatar
zhangqha committed
6
7

## 模型结构
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
8
模型核心是一个基于Transformer架构的神经网络,包括两个主要组件:Sequence to Sequence Model和Structure Model,这两个组件通过迭代训练进行优化,以提高其预测准确性。
zhangqha's avatar
zhangqha committed
9

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
10
![img](./alphafold2.png)
zhangqha's avatar
zhangqha committed
11

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
12
13
## 算法原理
通过从蛋白质序列和结构数据中提取信息,使用神经网络模型来预测蛋白质三维结构。
zhangqha's avatar
zhangqha committed
14

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
15
![img](./alphafold2_1.png)
zhangqha's avatar
zhangqha committed
16

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
17
## 环境配置
zhangqha's avatar
zhangqha committed
18
提供[光源](https://www.sourcefind.cn/#/service-details)拉取的训练的docker镜像:
19

zhangqha's avatar
zhangqha committed
20
```
yuhai's avatar
yuhai committed
21
等待上传镜像
22

yuhai's avatar
yuhai committed
23
docker run -it --network=host  -v <unifold代码路径>:<容器内路径> --shm-size=32G --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video  -v /opt/hyhal:/opt/hyhal:ro -v /opt/dtk-24.04.2-runtime/:/opt/dtk/:ro  --name <镜像名称> <上面获得的镜像ID> bash
Rayyyyy's avatar
Rayyyyy committed
24

yuhai's avatar
yuhai committed
25
cd /root/Uni-Fold
zhangqha's avatar
zhangqha committed
26
```
27

yuhai's avatar
yuhai committed
28
进行homosearch需要挂载AF2数据集至容器内`/alphafold`,若只为测试,本镜像无需挂载AF2数据集。
yuhai's avatar
yuhai committed
29
30
因为本镜像在昆山K100AI节点测试,dtk24.04.2不能正常使用,测试时挂载dtk-24.04.2-runtime至/opt/dtk。若确认dtk能正常使用可以选择不挂载,并修改/root目录下的/env.sh及Uni-Fold目录中的/opt/dtk为/opt/dtk-24.04.2

yuhai's avatar
yuhai committed
31
32
33
34
35
镜像版本依赖:
* DTK驱动:dtk24.04.2
* Pytorch: 2.1.0
* unifold: 2.2.0
* unicore: 0.0.1
yuhai's avatar
yuhai committed
36
* python: 3.10
37

yuhai's avatar
yuhai committed
38
39
40
41
测试目录:
`/root/Uni-Fold`

安装requirement.txt中的工具,镜像中已经安装好,加载方式
42

yuhai's avatar
yuhai committed
43
44
```
source /root/env.sh
zhangqha's avatar
zhangqha committed
45
```
Rayyyyy's avatar
Rayyyyy committed
46

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
47
## 数据集
Rayyyyy's avatar
Rayyyyy committed
48
推荐使用[AlphaFold2](http://113.200.138.88:18080/aidatasets/project-dependency/alphafold)中的开源数据集,包括BFD、MGnify、PDB70、Uniclust、Uniref90等,数据集大小约2.62TB。数据集格式如下:
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
49
```
Rayyyyy's avatar
Rayyyyy committed
50
51
$DOWNLOAD_DIR/
    bfd/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
52
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_hhm.ffindex
Rayyyyy's avatar
Rayyyyy committed
53
54
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_hhm.ffdata
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_cs219.ffindex
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
55
        ...
Rayyyyy's avatar
Rayyyyy committed
56
    mgnify/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
57
        mgy_clusters_2022_05.fa
Rayyyyy's avatar
Rayyyyy committed
58
    params/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
59
60
61
62
        params_model_1.npz
        params_model_2.npz
        params_model_3.npz
        ...
Rayyyyy's avatar
Rayyyyy committed
63
    pdb70/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
64
65
66
67
        pdb_filter.dat
        pdb70_hhm.ffindex
        pdb70_hhm.ffdata
        ...
Rayyyyy's avatar
Rayyyyy committed
68
    pdb_mmcif/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
69
70
71
72
73
74
        mmcif_files/
            100d.cif
            101d.cif
            101m.cif
            ...
        obsolete.dat
Rayyyyy's avatar
Rayyyyy committed
75
    pdb_seqres/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
76
        pdb_seqres.txt
Rayyyyy's avatar
Rayyyyy committed
77
    small_bfd/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
78
        bfd-first_non_consensus_sequences.fasta
Rayyyyy's avatar
Rayyyyy committed
79
    uniref30/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
80
81
82
83
        UniRef30_2021_03_hhm.ffindex
        UniRef30_2021_03_hhm.ffdata
        UniRef30_2021_03_cs219.ffindex
        ...
Rayyyyy's avatar
Rayyyyy committed
84
    uniprot/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
85
        uniprot.fasta
Rayyyyy's avatar
Rayyyyy committed
86
    uniref90/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
87
88
        uniref90.fasta
```
Rayyyyy's avatar
Rayyyyy committed
89

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
90
此处提供了一个脚本download_all_data.sh用于下载使用的数据集和模型文件:
Rayyyyy's avatar
Rayyyyy committed
91

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
92
93
94
95
96
```
bash scripts/download/download_all_data.sh /path/to/database/directory
```

## 推理
zhangqha's avatar
zhangqha committed
97
### 安装
98
#### 安装Uni-Core-main(如使用镜像,则无需再次安装)
zhangqha's avatar
zhangqha committed
99
```
zhangqha's avatar
zhangqha committed
100
cd Uni-Core-main
101

zhangqha's avatar
zhangqha committed
102
python3 setup.py install
zhangqha's avatar
zhangqha committed
103
```
Rayyyyy's avatar
Rayyyyy committed
104

105
#### 安装Uni-Fold-main(如使用镜像,则无需再次安装)
zhangqha's avatar
zhangqha committed
106
```
zhangqha's avatar
zhangqha committed
107
pip install -e .
zhangqha's avatar
zhangqha committed
108
```
Rayyyyy's avatar
Rayyyyy committed
109

dcuai's avatar
dcuai committed
110
### 多卡测试
yuhai's avatar
yuhai committed
111
112
113
114

如果没有挂载AF2数据集,会出现多体、单体测试脚本运行homosearch中报错`ValueError: Could not find hmmsearch database /alphafold/pdb_seqres/pdb_seqres.txt`并停止搜索、直接进行推理的情况,由于单本镜像内置了部分序列的搜索结果,因此可以无视此报错进行正常推理。
内置搜索结果的目录见`/root/Uni-Fold/data`,其中有H1036、H1072、T1024的搜索结果,若要选择其他序列进行推理,请挂载AF2数据集并进行homosearch(非常耗时)。

zhangqha's avatar
zhangqha committed
115
#### 多聚体参考脚本,需要根据实际情况修改路径配置
zhangqha's avatar
zhangqha committed
116
```
Rayyyyy's avatar
Rayyyyy committed
117
sh run_multimer.sh
zhangqha's avatar
zhangqha committed
118
```
Rayyyyy's avatar
Rayyyyy committed
119

zhangqha's avatar
zhangqha committed
120
#### 单聚体参考脚本,需要根据实际情况修改路径配置
zhangqha's avatar
zhangqha committed
121
```
zhangqha's avatar
zhangqha committed
122
sh run_monomer.sh
zhangqha's avatar
zhangqha committed
123
```
Rayyyyy's avatar
Rayyyyy committed
124

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
125
## result
zhangqha's avatar
zhangqha committed
126
![img](./result_pdb.png)
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
127

dcuai's avatar
dcuai committed
128
### 精度
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
129
130


Rayyyyy's avatar
Rayyyyy committed
131
## 应用场景
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
132
### 算法类别
dcuai's avatar
dcuai committed
133
蛋白质结构预测
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
134
135
136
137

### 热点应用行业
医疗,科研,教育

Rayyyyy's avatar
Rayyyyy committed
138
139
## 源码仓库及问题反馈
- https://developer.hpccube.com/codes/modelzoo/uni-fold
zhangqha's avatar
zhangqha committed
140

dcuai's avatar
dcuai committed
141
## 参考资料
Rayyyyy's avatar
Rayyyyy committed
142
- https://github.com/dptech-corp/Uni-Fold