nnDetectionV001.md

# nnDetection v0.1
## Pool v0.1

<div align="center">

<img src=./source/v001/results_full_final.svg width="800px">


&nbsp;

### Train Pool [AP @ IoU 0.1]

5 Fold Cross Validation

| Model       | LIDC                 | RibFrac  | CADA     | Kits19   |
|:-----------:|:--------------------:|:--------:|:--------:|:--------:|
| nnDetection | 0.605                | 0.765    | 0.924    | 0.923    |
| nnUNetPlus  | 0.385<sup>*</sup>    | 0.700    | 0.955    | 0.935    |
| nnUNetBasic | 0.346<sup>*</sup>    | 0.667    | 0.930    | 0.908    |

<sup>*</sup> results with corrected numerical values in softdice loss. Out of the box results: nnUNetPlus 0.304 and nnUNetBasic 0.232

&nbsp;

### Validation Pool [AP @ IoU 0.1]

5 Fold Cross Validation

| Model       | ADAM     | ProstateX  | Pancreas | Hepatic Vessel   | Colon | Liver |
|:-----------:|:--------:|:----------:|:--------:|:----------------:|:-----:|:-----:|
| nnDetection | 0.780    | 0.300      | 0.766    | 0.727            | 0.662 | 0.628 |
| nnUNetPlus  | 0.720    | 0.197      | 0.721    | 0.721            | 0.579 | 0.678 |
| nnUNetBasic | 0.657    | 0.204      | 0.691    | 0.699            | 0.509 | 0.567 |

&nbsp;

Test Split

| Model       | ProstateX  | Pancreas | Hepatic Vessel   | Colon | Liver |
|:-----------:|:----------:|:--------:|:----------------:|:-----:|:-----:|
| nnDetection | 0.221      | 0.791    | 0.664            | 0.696 | 0.790 |
| nnUNetPlus  | 0.078      | 0.704    | 0.684            | 0.731 | 0.760 |

ADAM Results are listed under Benchmarks

&nbsp;

### Test Pool [AP @ IoU 0.1]

5 Fold Cross Validation

| Model       | Lymph Nodes |
|:-----------:|:-----------:|
| nnDetection | 0.205       |
| nnUNetPlus  | 0.162       |
| nnUNetBasic | 0.159       |

&nbsp;

Test Split

| Model       | Lymph Nodes |
|:-----------:|:-----------:|
| nnDetection | 0.270       |
| nnUNetPlus  | 0.169       |

Luna results are listed under Benchmarks

&nbsp;

</div>

## Benchmarks
### Luna

<div align="center">

<img src=./source/v001/luna.png width="800px">

| Methods     | 1/8   | 1/4   | 1/2   | 1     | 2     | 4     | 8     | CPM   |
|:-----------:|:-----:|:-----:|:-----:|:-----:|:-----:|:-----:|:-----:|:-----:|
| nnDetection | 0.812 | 0.885 | 0.927 | 0.950 | 0.969 | 0.979 | 0.985 | 0.930 |

&nbsp;

</div>

### ADAM Live Leaderboard

<div align="center">

<img src=./source/v001/adam.svg width="300">


| Model       | Sens | FP  |
|:-----------:|:----:|:---:|
| nnDetection | 0.64 | 0.3 |

</div>