README.md 4.88 KB
Newer Older
zhangwenwei's avatar
zhangwenwei committed
1
<div align="center">
zhangwenwei's avatar
zhangwenwei committed
2
  <img src="resources/mmdet3d-logo.png" width="600"/>
zhangwenwei's avatar
zhangwenwei committed
3
</div>
zhangwenwei's avatar
zhangwenwei committed
4

zhangwenwei's avatar
zhangwenwei committed
5
6
7
**News**: We released the codebase v0.1.0.

Documentation: https://mmdetection3d.readthedocs.io/
zhangwenwei's avatar
zhangwenwei committed
8
9
10

## Introduction

zhangwenwei's avatar
zhangwenwei committed
11
The master branch works with **PyTorch 1.3 to 1.5**.
zhangwenwei's avatar
zhangwenwei committed
12

13
MMDetection3D is an open source object detection toolbox based on PyTorch, towards the next-generation platform for general 3D detection. It is
zhangwenwei's avatar
zhangwenwei committed
14
a part of the OpenMMLab project developed by [MMLab](http://mmlab.ie.cuhk.edu.hk/).
zhangwenwei's avatar
zhangwenwei committed
15

zhangwenwei's avatar
zhangwenwei committed
16
![demo image](resources/outdoor_demo.gif)
zhangwenwei's avatar
zhangwenwei committed
17
18
19

### Major features

zhangwenwei's avatar
zhangwenwei committed
20
- **Support multi-modality/single-modality detectors out of box**
zhangwenwei's avatar
zhangwenwei committed
21

22
  It directly supports multi-modality/single-modality detectors including MVXNet, VoteNet, PointPillars, etc.
zhangwenwei's avatar
zhangwenwei committed
23

zhangwenwei's avatar
zhangwenwei committed
24
- **Support indoor/outdoor 3D detection out of box**
zhangwenwei's avatar
zhangwenwei committed
25

26
  It directly supports popular indoor and outdoor 3D detection datasets, including ScanNet, SUNRGB-D, nuScenes, Lyft, and KITTI.
zhangwenwei's avatar
zhangwenwei committed
27

zhangwenwei's avatar
zhangwenwei committed
28
- **Natural integration with 2D detection**
29
30

  All the about **300 models, methods of 40+ papers**, and modules supported in [MMDetection](https://github.com/open-mmlab/mmdetection/blob/master/docs/model_zoo.md) can be trained or used in this codebase.
zhangwenwei's avatar
zhangwenwei committed
31

zhangwenwei's avatar
zhangwenwei committed
32
- **High efficiency**
zhangwenwei's avatar
zhangwenwei committed
33

34
  It trains [faster than other codebases](./docs/benchmarks.md).
zhangwenwei's avatar
zhangwenwei committed
35

36
Apart from MMDetection3D, we also released a library [MMDetection](https://github.com/open-mmlab/mmdetection) and [MMCV](https://github.com/open-mmlab/mmcv) for computer vision research, which are heavily depended on by this toolbox. Like [MMDetection](https://github.com/open-mmlab/mmdetection) and [MMCV](https://github.com/open-mmlab/mmcv), MMDetection3D can also be used as a library to support different projects on top of it.
zhangwenwei's avatar
zhangwenwei committed
37
38
39
40
41

## License

This project is released under the [Apache 2.0 license](LICENSE).

zhangwenwei's avatar
zhangwenwei committed
42
## Changelog
zhangwenwei's avatar
zhangwenwei committed
43

44
v0.1.0 was released in 9/7/2020.
zhangwenwei's avatar
zhangwenwei committed
45
Please refer to [changelog.md](docs/changelog.md) for details and release history.
zhangwenwei's avatar
zhangwenwei committed
46
47
48
49

## Benchmark and model zoo

Supported methods and backbones are shown in the below table.
zhangwenwei's avatar
zhangwenwei committed
50
Results and models are available in the [model zoo](docs/model_zoo.md).
zhangwenwei's avatar
zhangwenwei committed
51

zhangwenwei's avatar
zhangwenwei committed
52
53
|                    | ResNet   | ResNeXt  | SENet    |PointNet++ | HRNet | RegNetX | Res2Net |
|--------------------|:--------:|:--------:|:--------:|:---------:|:-----:|:--------:|:-----:|
54
55
56
| SECOND             | ☐        | ☐        | ☐        | ✗         | ☐     | ✓        | ☐     |
| PointPillars       | ☐        | ☐        | ☐        | ✗         | ☐     | ✓        | ☐     |
| FreeAnchor         | ☐        | ☐        | ☐        | ✗         | ☐     | ✓        | ☐     |
zhangwenwei's avatar
zhangwenwei committed
57
| VoteNet            | ✗        | ✗        | ✗        | ✓         | ✗     | ✗        | ✗     |
58
59
| Part-A2            | ☐        | ☐        | ☐        | ✗         | ☐     | ✓        | ☐     |
| MVXNet             | ☐        | ☐        | ☐        | ✗         | ☐     | ✓        | ☐     |
zhangwenwei's avatar
zhangwenwei committed
60
61
62
63

Other features
- [x] [Dynamic Voxelization](configs/carafe/README.md)

64
**Note:** All the about **300 models, methods of 40+ papers** in 2D detection supported by [MMDetection](https://github.com/open-mmlab/mmdetection/blob/master/docs/model_zoo.md) can be trained or used in this codebase.
zhangwenwei's avatar
zhangwenwei committed
65
66
67

## Installation

zhangwenwei's avatar
zhangwenwei committed
68
Please refer to [install.md](docs/install.md) for installation and dataset preparation.
zhangwenwei's avatar
zhangwenwei committed
69
70
71

## Get Started

zhangwenwei's avatar
zhangwenwei committed
72
Please see [getting_started.md](docs/getting_started.md) for the basic usage of MMDetection. There are also tutorials for [finetuning models](docs/tutorials/finetune.md), [adding new dataset](docs/tutorials/new_dataset.md), [designing data pipeline](docs/tutorials/data_pipeline.md), and [adding new modules](docs/tutorials/new_modules.md).
zhangwenwei's avatar
zhangwenwei committed
73
74
75

## Contributing

zhangwenwei's avatar
zhangwenwei committed
76
We appreciate all contributions to improve MMDetection3D. Please refer to [CONTRIBUTING.md](.github/CONTRIBUTING.md) for the contributing guideline.
zhangwenwei's avatar
zhangwenwei committed
77
78
79

## Acknowledgement

zhangwenwei's avatar
zhangwenwei committed
80
MMDetection3D is an open source project that is contributed by researchers and engineers from various colleges and companies. We appreciate all the contributors as well as users who give valuable feedbacks.
zhangwenwei's avatar
zhangwenwei committed
81
We wish that the toolbox and benchmark could serve the growing research community by providing a flexible toolkit to reimplement existing methods and develop their own new 3D detectors.
zhangwenwei's avatar
zhangwenwei committed
82
83
84

## Citation

zhangwenwei's avatar
zhangwenwei committed
85
86
87
88
89
If you use this toolbox or benchmark in your research, please cite this project.

```
@misc{mmdetection3d_2020,
  title   = {{MMDetection3D}},
zhangwenwei's avatar
zhangwenwei committed
90
91
92
  author  = {Zhang, Wenwei and Wu, Yuefeng and Wang, Tai and Li, Yinhao and
             Lin, Kwan-Yee and Wang, Zhe and Shi, Jianping and Qian, Chen and
             Chen, Kai, and Lin, Dahua and Loy, Chen Change},
zhangwenwei's avatar
zhangwenwei committed
93
94
95
96
  howpublished = {\url{https://github.com/open-mmlab/mmdetection3d}},
  year =         {2020}
}
```
zhangwenwei's avatar
zhangwenwei committed
97
98
99

## Contact

zhangwenwei's avatar
zhangwenwei committed
100
This repo is currently maintained by Wenwei Zhang ([@ZwwWayne](https://github.com/ZwwWayne)), Yuefeng Wu ([@xavierwu95](https://github.com/xavierwu95)), Tai Wang ([@Tai-Wang](https://github.com/Tai-Wang)), and Yinhao Li ([@yinchimaoliang](https://github.com/yinchimaoliang)).