• Qianli Scott Zhu's avatar
    Resnet benchmark logging (#3704) · b9b44f7b
    Qianli Scott Zhu authored
    * Update reset model for benchmark logging.
    
    To enable benchmark logging, just add "--hooks LoggingMetricHook"
    
    * Benchmark logger fix for resnet.
    
    1. Update default at_end to False for metric logger to avoid
    checkpoint error.
    2. Update resnet run to log final evaluation result.
    
    * Update log output for final eval_result.
    
    * Typo fix.
    
    * Unset the default value for benchmark_log_dir.
    
    Usually the benchmark should be logged to different directly for
    each run. Having a default value will hide the choice from user.
    
    * Bug fix for benchmark logger initialization.
    
    * Fix lint error.
    
    * Address the review comment.
    
    1. Update the logger to cover evaluation result.
    2. Move the flag to performance parser.
    
    * Undo the change for arg_parser.
    b9b44f7b
logger.py 3.38 KB