Commit 92aa2fa8 authored by zachteed's avatar zachteed
Browse files

initial commit

parents
{
"background_color" : [ 1, 1, 1 ],
"class_name" : "RenderOption",
"default_mesh_color" : [ 0.69999999999999996, 0.69999999999999996, 0.69999999999999996 ],
"image_max_depth" : 3000,
"image_stretch_option" : 0,
"interpolation_option" : 0,
"light0_color" : [ 1, 1, 1 ],
"light0_diffuse_power" : 0.66000000000000003,
"light0_position" : [ 0, 0, 2 ],
"light0_specular_power" : 0.20000000000000001,
"light0_specular_shininess" : 100,
"light1_color" : [ 1, 1, 1 ],
"light1_diffuse_power" : 0.66000000000000003,
"light1_position" : [ 0, 0, 2 ],
"light1_specular_power" : 0.20000000000000001,
"light1_specular_shininess" : 100,
"light2_color" : [ 1, 1, 1 ],
"light2_diffuse_power" : 0.66000000000000003,
"light2_position" : [ 0, 0, -2 ],
"light2_specular_power" : 0.20000000000000001,
"light2_specular_shininess" : 100,
"light3_color" : [ 1, 1, 1 ],
"light3_diffuse_power" : 0.66000000000000003,
"light3_position" : [ 0, 0, -2 ],
"light3_specular_power" : 0.20000000000000001,
"light3_specular_shininess" : 100,
"light_ambient_color" : [ 0, 0, 0 ],
"light_on" : true,
"mesh_color_option" : 1,
"mesh_shade_option" : 0,
"mesh_show_back_face" : false,
"mesh_show_wireframe" : false,
"point_color_option" : 9,
"point_show_normal" : false,
"point_size" : 2,
"show_coordinate_frame" : false,
"version_major" : 1,
"version_minor" : 0
}
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
## SE3 / Sim3 Registration
Estimate the 3D transformation between two RGB-D frames
<img src="assets/registration.gif" width="480">
### Models
| Model | Rot. Acc. | Tr. Acc. | Scale Acc. |
| --------- | --------- | -------- | ---------- |
| [se3.pth](https://drive.google.com/file/d/17pgeY5m-GXnrY3oFLPRaIrTZYvae_l9u/view?usp=sharing) | 91.90 | 77.70 | - |
| [sim3.pth](https://drive.google.com/file/d/1LMnKND_4DAmd9DMTSKdz_zAoCgja6X43/view?usp=sharing) | 93.45 | 76.05 | 98.70 |
for thresholds 0.1 deg. rotation error, 1cm translation error, and 1% scale error.
### Demo
Download one of the models to run the demo (requres Open3D)
```python
python demo.py --transformation=SE3 --ckpt=se3.pth
python demo.py --transformation=Sim3 --ckpt=sim3.pth
```
### Training and Evaluation
Training and evaluation is performed on the [TartanAir](https://theairlab.org/tartanair-dataset/) (only depth_left and image_left need to be downloaded). Note: our dataloader computes the optical flow between every pair of frames which can take several hours on the first run. However, this result is cached so that future loads will only take a few seconds.
The training script expects the dataset to be in the directory datasets/TartanAir.
To train a Sim3 network:
```python
python main.py --train --transformation=Sim3 --name=sim3
```
A trained model can then be evaluated:
```python
python main.py --transformation=Sim3 --ckpt=sim3.pth
```
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment