nnDetectionV001.md 2.24 KB
Newer Older
mibaumgartner's avatar
mibaumgartner committed
1
2
3
4
5
# nnDetection v0.1
## Pool v0.1

<div align="center">

mibaumgartner's avatar
mibaumgartner committed
6
<img src=./source/v001/results_full.svg width="800px">
mibaumgartner's avatar
mibaumgartner committed
7

mibaumgartner's avatar
mibaumgartner committed
8
9

&nbsp;
mibaumgartner's avatar
mibaumgartner committed
10
11
12
13
14
15
16
17
18
19
20

### Train Pool [AP @ IoU 0.1]

5 Fold Cross Validation

| Model       | LIDC     | RibFrac  | CADA     | Kits19   |
|:-----------:|:--------:|:--------:|:--------:|:--------:|
| nnDetection | 0.605    | 0.765    | 0.924    | 0.923    |
| nnUNetPlus  | 0.304    | 0.700    | 0.955    | 0.935    |
| nnUNetBasic | 0.232    | 0.667    | 0.930    | 0.908    |

mibaumgartner's avatar
mibaumgartner committed
21
22
&nbsp;

mibaumgartner's avatar
mibaumgartner committed
23
24
25
26
27
28
29
30
31
32
### Validation Pool [AP @ IoU 0.1]

5 Fold Cross Validation

| Model       | ADAM     | ProstateX  | Pancreas | Hepatic Vessel   | Colon | Liver |
|:-----------:|:--------:|:----------:|:--------:|:----------------:|:-----:|:-----:|
| nnDetection | 0.780    | 0.300      | 0.766    | 0.727            | 0.662 | 0.628 |
| nnUNetPlus  | 0.720    | 0.197      | 0.721    | 0.721            | 0.579 | 0.678 |
| nnUNetBasic | 0.657    | 0.204      | 0.691    | 0.699            | 0.509 | 0.567 |

mibaumgartner's avatar
mibaumgartner committed
33
34
&nbsp;

mibaumgartner's avatar
mibaumgartner committed
35
36
37
38
39
40
41
42
43
Test Split

| Model       | ProstateX  | Pancreas | Hepatic Vessel   | Colon | Liver |
|:-----------:|:----------:|:--------:|:----------------:|:-----:|:-----:|
| nnDetection | 0.221      | 0.791    | 0.664            | 0.696 | 0.790 |
| nnUNetPlus  | 0.078      | 0.704    | 0.684            | 0.731 | 0.760 |

ADAM Results are listed under Benchmarks

mibaumgartner's avatar
mibaumgartner committed
44
45
&nbsp;

mibaumgartner's avatar
mibaumgartner committed
46
47
48
49
50
51
52
53
54
55
### Test Pool [AP @ IoU 0.1]

5 Fold Cross Validation

| Model       | Lymph Nodes |
|:-----------:|:-----------:|
| nnDetection | 0.205       |
| nnUNetPlus  | 0.162       |
| nnUNetBasic | 0.159       |

mibaumgartner's avatar
mibaumgartner committed
56
57
&nbsp;

mibaumgartner's avatar
mibaumgartner committed
58
59
60
61
62
63
64
65
66
Test Split

| Model       | Lymph Nodes |
|:-----------:|:-----------:|
| nnDetection | 0.270       |
| nnUNetPlus  | 0.169       |

Luna results are listed under Benchmarks

mibaumgartner's avatar
mibaumgartner committed
67
68
69
70
&nbsp;

</div>

mibaumgartner's avatar
mibaumgartner committed
71
72
73
74
75
## Benchmarks
### Luna

<div align="center">

mibaumgartner's avatar
mibaumgartner committed
76
<img src=./source/v001/luna.png width="800px">
mibaumgartner's avatar
mibaumgartner committed
77
78
79
80
81

| Methods     | 1/8   | 1/4   | 1/2   | 1     | 2     | 4     | 8     | CPM   |
|:-----------:|:-----:|:-----:|:-----:|:-----:|:-----:|:-----:|:-----:|:-----:|
| nnDetection | 0.812 | 0.885 | 0.927 | 0.950 | 0.969 | 0.979 | 0.985 | 0.930 |

mibaumgartner's avatar
mibaumgartner committed
82
83
84
85
&nbsp;

</div>

mibaumgartner's avatar
mibaumgartner committed
86
87
88
89
### ADAM Live Leaderboard

<div align="center">

mibaumgartner's avatar
mibaumgartner committed
90
<img src=./source/v001/adam.svg width="300">
mibaumgartner's avatar
mibaumgartner committed
91
92
93
94
95


| Model       | Sens | FP  |
|:-----------:|:----:|:---:|
| nnDetection | 0.64 | 0.3 |
mibaumgartner's avatar
mibaumgartner committed
96
97

</div>