deprecate terminate_on_nan in pytorch lightning's default trainer config

Summary: deprecate terminate_on_nan in pytorch lightning's default trainer config

Reviewed By: kazhang, wat3rBro

Differential Revision: D30910709

fbshipit-source-id: cb22c1f5f1cf3a3236333f21be87756d3f657f78

tools/lightning_train_net.py

@@ -102,7 +102,6 @@ def get_trainer_params(
         "logger": TensorBoardLogger(save_dir=cfg.OUTPUT_DIR),
         "num_sanity_val_steps": 0,
         "progress_bar_refresh_rate": 10,
-        "terminate_on_nan": True,
         "replace_sampler_ddp": False,
         "plugins": plugins,
     }