README.md 4 KB
Newer Older
dcuai's avatar
dcuai committed
1
2
3
4
# Higashi

## 论文

wangsen's avatar
wangsen committed
5
6
https://doi.org/10.1038/s41587-021-01034-y

dcuai's avatar
dcuai committed
7
## 模型结构
wangsen's avatar
wangsen committed
8
9
10
11
12
13
14


Higashi使用超图神经网络来揭示这个构造的超图中的高阶交互模式。Higashi可以为scHi-C制作嵌入物,用于下游分析。Higashi可以输入单细胞Hi-C接触图谱,从而能够以单细胞分辨率详细表征3D基因组特征,如TAD样结构域边界和A/B区分数。

![Alt text](./image/image.png)


dcuai's avatar
dcuai committed
15
## 算法原理
wangsen's avatar
wangsen committed
16
17
18
19
20
21

Higashi的关键算法设计是将scHi-C数据转换为超图。这种转化保留了scHi-C接触图谱的单细胞分辨率和3D基因组特征。具体来说,嵌入scHi-C数据的过程现在相当于学习超图的节点嵌入,输入scHi-C接触图就变成了预测超图中缺失的超边。在Higashi,我们使用我们最近开发的Hyper-SAGNN架构22,这是一个通用的超图表示学习框架,专门针对scHi-C分析进行了大量的新开发

![Alt text](./image/image-1.png)


dcuai's avatar
dcuai committed
22
23
## 环境配置
### Docker(方式一)
wangsen's avatar
wangsen committed
24
推荐使用docker方式运行,提供拉取的docker镜像:
wangsen's avatar
wangsen committed
25

wangsen's avatar
wangsen committed
26
27
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu20.04-dtk24.04.1-py3.10
wangsen's avatar
wangsen committed
28
29
docker run -dit --shm-size 80g --network=host --name=higashi --privileged --device=/dev/kfd --device=/dev/dri --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root -v /opt/hyhal/:/opt/hyhal/:ro image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu20.04-dtk24.04.1-py3.10 /bin/bash
docker exec -it higashi /bin/bash
wangsen's avatar
wangsen committed
30
31
32
33
34
35
```

安装docker中没有的依赖:

```
pip install -r requirements.txt  -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
wangsen's avatar
wangsen committed
36
python setup.py install
wangsen's avatar
wangsen committed
37
38
```

dcuai's avatar
dcuai committed
39
### Dockerfile(方式二)
wangsen's avatar
wangsen committed
40
41

```
wangsen's avatar
wangsen committed
42
docker build -t higashi:latest .
wangsen's avatar
wangsen committed
43
docker run -dit --shm-size 80g --network=host --name=higashi --privileged --device=/dev/kfd --device=/dev/dri --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root -v /opt/hyhal/:/opt/hyhal/:ro higashi:latest /bin/bash
wangsen's avatar
wangsen committed
44
docker exec -it higashi  /bin/bash
wangsen's avatar
wangsen committed
45
46

```
wangsen's avatar
wangsen committed
47
安装docker中没有的依赖:
wangsen's avatar
wangsen committed
48

wangsen's avatar
wangsen committed
49
50
51
52
```
pip install -r requirements.txt  -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
python setup.py install
```
wangsen's avatar
wangsen committed
53
54


dcuai's avatar
dcuai committed
55
### Conda(方式三)
wangsen's avatar
wangsen committed
56
57
58
59

1.创建conda虚拟环境:

```
wangsen's avatar
wangsen committed
60
61
conda create -n higashi python=3.10
conda activate higashi 
wangsen's avatar
wangsen committed
62
63
64
65
66
67
68
69
70
71
```

2.关于本项目DCU显卡所需的工具包、深度学习库等均可从光合开发者社区下载安装。
- [DTK 24.04.1](https://cancon.hpccube.com:65024/directlink/1/DTK-24.04.1/Ubuntu20.04.1/DTK-24.04.1-Ubuntu20.04.1-x86_64.tar.gz)
- [Pytorch 2.1](https://cancon.hpccube.com:65024/directlink/4/pytorch/DAS1.2/torch-2.1.0+das.opt1.dtk24042-cp310-cp310-manylinux_2_28_x86_64.whl)


Tips:以上dtk驱动、torch等工具版本需要严格一一对应。


wangsen's avatar
wangsen committed
72
3.其它依赖库参照requirements.txt安装:
wangsen's avatar
wangsen committed
73
```
wangsen's avatar
wangsen committed
74
python setup.py install
wangsen's avatar
wangsen committed
75
76
77
pip install -r requirements.txt -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
```

dcuai's avatar
dcuai committed
78
## 数据集
wangsen's avatar
wangsen committed
79

chenzk's avatar
chenzk committed
80
- ramani数据集:ramani-et-ai根据源README查找
wangsen's avatar
wangsen committed
81

wangsen's avatar
wangsen committed
82
```
wangsen's avatar
wangsen committed
83
84
apt-get update 
apt-get install git-lfs
wangsen's avatar
wangsen committed
85
86
87
88
mkdir -p /work/magroup/ruochiz/Data/scHiC_collection/ramani
mkdir -p /work/magroup/ruochiz/Higashi/Temp/ramani
wget -P  /work/magroup/ruochiz/Higashi/ https://mirror.ghproxy.com/https://raw.githubusercontent.com/hanfang/Topsorter/refs/heads/master/data/hg19.chrom.sizes.txt
wget -P  /work/magroup/ruochiz/Higashi/   https://hgdownload.cse.ucsc.edu/goldenpath/hg19/database/cytoBand.txt.gz
wangsen's avatar
wangsen committed
89
cp -r ramani-et-ai/* /work/magroup/ruochiz/Data/scHiC_collection/ramani/ 
wangsen's avatar
wangsen committed
90
91
92
```


dcuai's avatar
dcuai committed
93
## 训练
wangsen's avatar
wangsen committed
94

dcuai's avatar
dcuai committed
95
结合测试数据和Higashi模型生成具备超图分析与接触图嵌入能力的demo
wangsen's avatar
wangsen committed
96
97
98
99

```
python train.py 
```
dcuai's avatar
dcuai committed
100
101
## 推理

wangsen's avatar
wangsen committed
102

dcuai's avatar
dcuai committed
103
## result
dcuai's avatar
dcuai committed
104

dcuai's avatar
dcuai committed
105
106

### 精度
wangsen's avatar
wangsen committed
107

wangsen's avatar
wangsen committed
108
bce:  0.5046, mse:  0.7233,  acc: 86.692 %, pearson: 0.590, spearman: 0.514, elapse: 27.894 s 
wangsen's avatar
wangsen committed
109

dcuai's avatar
dcuai committed
110
111
## 应用场景
### 算法类别
wangsen's avatar
wangsen committed
112
ai for science
wangsen's avatar
wangsen committed
113

dcuai's avatar
dcuai committed
114
### 热点应用行业
wangsen's avatar
wangsen committed
115
116
117

科研  单细胞预测    基因预测

dcuai's avatar
dcuai committed
118
## 源码仓库及问题反馈
wangsen's avatar
wangsen committed
119

dcuai's avatar
dcuai committed
120
https://developer.sourcefind.cn/codes/modelzoo/higashi_pytorch
wangsen's avatar
wangsen committed
121

wangsen's avatar
wangsen committed
122
123


dcuai's avatar
dcuai committed
124
## 参考资料
wangsen's avatar
wangsen committed
125
126


wangsen's avatar
wangsen committed
127
https://github.com/ma-compbio/Higashi/
wangsen's avatar
wangsen committed
128

wangsen's avatar
wangsen committed
129
130
131