switch to test set

README.md

@@ -10,10 +10,10 @@ python examples/trainval.py
 
 ## Performance Reference
 
-Tested with the default settings on the Lego dataset.
+Tested with the default settings on the Lego test set.
 
 | Model | Split | PSNR | Train Time | Test Speed | GPU |
 | - | - | - | - | - | - |
 | instant-ngp (paper)            | trainval?            | 36.39  |  -   | -    | 3090    |
 | torch-ngp (`-O`)               | train (30K steps)    | 34.15  |  310 sec  | 7.8 fps  | V100 |
-| ours                           | train (30K steps)    | 34.42  |  320 sec  | 6.1 fps | TITAN RTX  |
+| ours                           | train (30K steps)    | 33.27  |  318 sec  | 6.2 fps | TITAN RTX  |
\ No newline at end of file

examples/trainval.py

@@ -76,7 +76,7 @@ if __name__ == "__main__":
     val_dataset = SubjectLoader(
         subject_id="lego",
         root_fp="/home/ruilongli/data/nerf_synthetic/",
-        split="val",
+        split="test",
         num_rays=None,
     )
     val_dataloader = torch.utils.data.DataLoader(
@@ -176,5 +176,5 @@ if __name__ == "__main__":
                 psnr_avg = sum(psnrs) / len(psnrs)
                 print(f"evaluation: {psnr_avg=}")
 
-# elapsed_time=320.04s | step=30000 | loss= 0.00022
-# evaluation: psnr_avg=34.41712421417236 (6.13 it/s)
+# elapsed_time=317.59s | step=30000 | loss= 0.00028
+# evaluation: psnr_avg=33.27096959114075 (6.24 it/s)