• Qianli Scott Zhu's avatar
    Add benchmark logger that does stream upload to bigquery. (#4210) · 0270cac7
    Qianli Scott Zhu authored
    * Move the benchmark_uploader to new location.
    
    * Update benchmark logger to streaming upload.
    
    * Fix lint and unit test error.
    
    * delint.
    
    * Update the benchmark uploader test.
    
    Skip the import of benchmark_uploader when bigquery is not installed.
    
    * Merge the 2 classes of benchmark uploader into 1.
    
    * Address review comments.
    
    * delint.
    
    * Execute bigquery upload in a separate thread.
    
    * Change to use python six.moves for importing.
    
    * Address review comments and delint.
    
    * Address review comment.
    
    Adding comment for potential performance impact for model on CPU.
    
    * Fix random failure on py3.
    
    * Fix the order of flag saver to avoid the randomness.
    
    The test is broken when the benchmark_logger_type is set first, and
    validated when the benchmark_log_dir is not set yet.
    0270cac7
__init__.py 0 Bytes