README.md 4.26 KB
Newer Older
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
1
# Uni-Fold
2

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
3
## 论文
Rayyyyy's avatar
Rayyyyy committed
4
5
`Uni-Fold: An Open-Source Platform for Developing Protein Folding Models beyond AlphaFold`
- https://www.biorxiv.org/content/biorxiv/early/2022/08/06/2022.08.04.502811.full.pdf
zhangqha's avatar
zhangqha committed
6
7

## 模型结构
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
8
模型核心是一个基于Transformer架构的神经网络,包括两个主要组件:Sequence to Sequence Model和Structure Model,这两个组件通过迭代训练进行优化,以提高其预测准确性。
zhangqha's avatar
zhangqha committed
9

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
10
![img](./alphafold2.png)
zhangqha's avatar
zhangqha committed
11

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
12
13
## 算法原理
通过从蛋白质序列和结构数据中提取信息,使用神经网络模型来预测蛋白质三维结构。
zhangqha's avatar
zhangqha committed
14

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
15
![img](./alphafold2_1.png)
zhangqha's avatar
zhangqha committed
16

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
17
## 环境配置
zhangqha's avatar
zhangqha committed
18
提供[光源](https://www.sourcefind.cn/#/service-details)拉取的训练的docker镜像:
19

zhangqha's avatar
zhangqha committed
20
```
yuhai's avatar
yuhai committed
21
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:unifold-torch2.1.0-dtk24.04.2-ubuntu20.04-py310
22

dcuai's avatar
dcuai committed
23
docker run -it --network=host  -v <unifold代码路径>:<容器内unifold代码路径> --shm-size=32G --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video  -v /opt/hyhal:/opt/hyhal:ro --name <镜像名称> <上面获得的镜像ID> bash
Rayyyyy's avatar
Rayyyyy committed
24

yuhai's avatar
yuhai committed
25
26
mv -f <容器内unifold代码路径>/run_monomer.sh  /root/Uni-Fold/run_monomer.sh
mv -f <容器内unifold代码路径>/run_multimer.sh /root/Uni-Fold/run_multimer.sh
yuhai's avatar
yuhai committed
27
cd /root/Uni-Fold
zhangqha's avatar
zhangqha committed
28
```
29

dcuai's avatar
dcuai committed
30
进行homosearch需要挂载AF2数据集至容器内`/alphafold`,若只为测试,本镜像可不挂载AF2数据集。
yuhai's avatar
yuhai committed
31

yuhai's avatar
yuhai committed
32
33
34
35
36
镜像版本依赖:
* DTK驱动:dtk24.04.2
* Pytorch: 2.1.0
* unifold: 2.2.0
* unicore: 0.0.1
yuhai's avatar
yuhai committed
37
* python: 3.10
38

yuhai's avatar
yuhai committed
39
40
41
测试目录:
`/root/Uni-Fold`

yuhai's avatar
yuhai committed
42
安装requirement.txt中的工具,镜像中已经安装好加载方式:
43

yuhai's avatar
yuhai committed
44
45
```
source /root/env.sh
zhangqha's avatar
zhangqha committed
46
```
Rayyyyy's avatar
Rayyyyy committed
47

yuhai's avatar
yuhai committed
48
49
若报错`rm: cannot remove 'software': No such file or directory`等不必理会,其中的rm命令只是希望删除两个空文件夹。

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
50
## 数据集
chenzk's avatar
chenzk committed
51
包括BFD、MGnify、PDB70、Uniclust、Uniref90等,数据集大小约2.62TB。数据集格式如下:
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
52
```
Rayyyyy's avatar
Rayyyyy committed
53
54
$DOWNLOAD_DIR/
    bfd/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
55
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_hhm.ffindex
Rayyyyy's avatar
Rayyyyy committed
56
57
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_hhm.ffdata
        bfd_metaclust_clu_complete_id30_c90_final_seq.sorted_opt_cs219.ffindex
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
58
        ...
Rayyyyy's avatar
Rayyyyy committed
59
    mgnify/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
60
        mgy_clusters_2022_05.fa
Rayyyyy's avatar
Rayyyyy committed
61
    params/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
62
63
64
65
        params_model_1.npz
        params_model_2.npz
        params_model_3.npz
        ...
Rayyyyy's avatar
Rayyyyy committed
66
    pdb70/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
67
68
69
70
        pdb_filter.dat
        pdb70_hhm.ffindex
        pdb70_hhm.ffdata
        ...
Rayyyyy's avatar
Rayyyyy committed
71
    pdb_mmcif/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
72
73
74
75
76
77
        mmcif_files/
            100d.cif
            101d.cif
            101m.cif
            ...
        obsolete.dat
Rayyyyy's avatar
Rayyyyy committed
78
    pdb_seqres/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
79
        pdb_seqres.txt
Rayyyyy's avatar
Rayyyyy committed
80
    small_bfd/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
81
        bfd-first_non_consensus_sequences.fasta
Rayyyyy's avatar
Rayyyyy committed
82
    uniref30/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
83
84
85
86
        UniRef30_2021_03_hhm.ffindex
        UniRef30_2021_03_hhm.ffdata
        UniRef30_2021_03_cs219.ffindex
        ...
Rayyyyy's avatar
Rayyyyy committed
87
    uniprot/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
88
        uniprot.fasta
Rayyyyy's avatar
Rayyyyy committed
89
    uniref90/
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
90
91
        uniref90.fasta
```
Rayyyyy's avatar
Rayyyyy committed
92

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
93
此处提供了一个脚本download_all_data.sh用于下载使用的数据集和模型文件:
Rayyyyy's avatar
Rayyyyy committed
94

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
95
96
97
98
99
```
bash scripts/download/download_all_data.sh /path/to/database/directory
```

## 推理
dcuai's avatar
dcuai committed
100
<!--
zhangqha's avatar
zhangqha committed
101
### 安装
102
#### 安装Uni-Core-main(如使用镜像,则无需再次安装)
zhangqha's avatar
zhangqha committed
103
```
zhangqha's avatar
zhangqha committed
104
cd Uni-Core-main
105

zhangqha's avatar
zhangqha committed
106
python3 setup.py install
zhangqha's avatar
zhangqha committed
107
```
Rayyyyy's avatar
Rayyyyy committed
108

109
#### 安装Uni-Fold-main(如使用镜像,则无需再次安装)
zhangqha's avatar
zhangqha committed
110
```
zhangqha's avatar
zhangqha committed
111
pip install -e .
zhangqha's avatar
zhangqha committed
112
```
dcuai's avatar
dcuai committed
113
### 多卡测试
dcuai's avatar
dcuai committed
114
!-->
yuhai's avatar
yuhai committed
115
如果没有挂载AF2数据集,会出现多体、单体测试脚本运行homosearch中报错`ValueError: Could not find hmmsearch database /alphafold/pdb_seqres/pdb_seqres.txt`并停止搜索、直接进行推理的情况,由于本镜像内置了部分序列的搜索结果,因此可以无视此报错进行正常推理。
yuhai's avatar
yuhai committed
116
117
内置搜索结果的目录见`/root/Uni-Fold/data`,其中有H1036、H1072、T1024的搜索结果,若要选择其他序列进行推理,请挂载AF2数据集并进行homosearch(非常耗时)。

zhangqha's avatar
zhangqha committed
118
#### 多聚体参考脚本,需要根据实际情况修改路径配置
zhangqha's avatar
zhangqha committed
119
```
yuhai's avatar
yuhai committed
120
bash run_multimer.sh
zhangqha's avatar
zhangqha committed
121
```
Rayyyyy's avatar
Rayyyyy committed
122

zhangqha's avatar
zhangqha committed
123
#### 单聚体参考脚本,需要根据实际情况修改路径配置
zhangqha's avatar
zhangqha committed
124
```
yuhai's avatar
yuhai committed
125
bash run_monomer.sh
zhangqha's avatar
zhangqha committed
126
```
Rayyyyy's avatar
Rayyyyy committed
127

zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
128
## result
zhangqha's avatar
zhangqha committed
129
![img](./result_pdb.png)
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
130

dcuai's avatar
dcuai committed
131
### 精度
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
132
133


Rayyyyy's avatar
Rayyyyy committed
134
## 应用场景
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
135
### 算法类别
dcuai's avatar
dcuai committed
136
蛋白质结构预测
zhangqha@sugon.com's avatar
zhangqha@sugon.com committed
137
138
139
140

### 热点应用行业
医疗,科研,教育

Rayyyyy's avatar
Rayyyyy committed
141
## 源码仓库及问题反馈
chenzk's avatar
chenzk committed
142
- https://developer.sourcefind.cn/codes/modelzoo/uni-fold
zhangqha's avatar
zhangqha committed
143

dcuai's avatar
dcuai committed
144
## 参考资料
Rayyyyy's avatar
Rayyyyy committed
145
- https://github.com/dptech-corp/Uni-Fold