dnerf.rst 1.84 KB
Newer Older
Ruilong Li(李瑞龙)'s avatar
Ruilong Li(李瑞龙) committed
1
Dynamic Scene
Ruilong Li(李瑞龙)'s avatar
Ruilong Li(李瑞龙) committed
2
3
====================

Ruilong Li(李瑞龙)'s avatar
Ruilong Li(李瑞龙) committed
4
5
6
7
Here we trained a 8-layer-MLP for the radiance field and a 4-layer-MLP for the warping field,
(similar to the T-Nerf model in the `D-Nerf`_ paper) on the `D-Nerf dataset`_. We used train 
split for training and test split for evaluation. Our experiments are conducted on a 
single NVIDIA TITAN RTX GPU. 
Ruilong Li(李瑞龙)'s avatar
Ruilong Li(李瑞龙) committed
8

Ruilong Li(李瑞龙)'s avatar
Ruilong Li(李瑞龙) committed
9
10
11
12
13
Note:
    The :ref:`Occupancy Grid` used in this example is shared by all the frames. In other words, 
    instead of using it to indicate the opacity of an area at a single timestamp, 
    Here we use it to indicate the `maximum` opacity at this area `over all the timestamps`.
    It is not optimal but still makes the rendering very efficient.
Ruilong Li(李瑞龙)'s avatar
Ruilong Li(李瑞龙) committed
14

15
16
17
18
+----------------------+----------+---------+-------+---------+-------+--------+---------+-------+-------+
|                      | bouncing | hell    | hook  | jumping | lego  | mutant | standup | trex  | AVG   |
|                      | balls    | warrior |       | jacks   |       |        |         |       |       |
+======================+==========+=========+=======+=========+=======+========+=========+=======+=======+
Ruilong Li(李瑞龙)'s avatar
Ruilong Li(李瑞龙) committed
19
| D-Nerf (PSNR: ~2day) | 38.93    | 25.02   | 29.25 | 32.80   | 21.64 | 31.29  | 32.79   | 31.75 | 30.43 |
20
21
22
23
24
+----------------------+----------+---------+-------+---------+-------+--------+---------+-------+-------+
| Ours  (PSNR: ~50min) | 39.60    | 22.41   | 30.64 | 29.79   | 24.75 | 35.20  | 34.50   | 31.83 | 31.09 |
+----------------------+----------+---------+-------+---------+-------+--------+---------+-------+-------+
| Ours  (Training time)| 45min    | 49min   | 51min | 46min   | 53min | 57min  | 49min   | 46min | 50min |
+----------------------+----------+---------+-------+---------+-------+--------+---------+-------+-------+
Ruilong Li(李瑞龙)'s avatar
Ruilong Li(李瑞龙) committed
25
26
27

.. _`D-Nerf`: https://arxiv.org/abs/2104.00677
.. _`D-Nerf dataset`: https://www.dropbox.com/s/0bf6fl0ye2vz3vr/data.zip?dl=0