1. 01 Jun, 2018 2 commits
    • Qianli Scott Zhu's avatar
      Add new test ID and test env info to the benchmark run. (#4426) · d2d6ab4c
      Qianli Scott Zhu authored
      * Add new test ID and test env info to the benchmark run.
      
      * Fix test.
      
      * Fix lint
      
      * Address review comment.
      d2d6ab4c
    • Qianli Scott Zhu's avatar
      Record the status for a benchmark run. (#4402) · 47c5642e
      Qianli Scott Zhu authored
      * Update benchmark logger to update the run status.
      
      This is important for streaming upload to bigquery so that the
      dashboard can ignore the 'running' benchmark at the moment since
      its not finished yet.
      
      * Move the run status into a separate table.
      
      Also update the run status in the benchmark uploader and
      BigqueryBenchmarkLogger.
      
      * Insert instead of update for the benchmark status for file logger.
      
      * Address review comments.
      
      Update the logger to have benchmark context, which will update the
      run status accordingly.
      
      * Fix broken tests.
      
      * Move the benchmark logger context to main function.
      
      * Fix tests.
      
      * Update the rest of the models to use the context in main.
      
      * Delint.
      47c5642e
  2. 11 May, 2018 1 commit
    • Qianli Scott Zhu's avatar
      Add benchmark logger that does stream upload to bigquery. (#4210) · 0270cac7
      Qianli Scott Zhu authored
      * Move the benchmark_uploader to new location.
      
      * Update benchmark logger to streaming upload.
      
      * Fix lint and unit test error.
      
      * delint.
      
      * Update the benchmark uploader test.
      
      Skip the import of benchmark_uploader when bigquery is not installed.
      
      * Merge the 2 classes of benchmark uploader into 1.
      
      * Address review comments.
      
      * delint.
      
      * Execute bigquery upload in a separate thread.
      
      * Change to use python six.moves for importing.
      
      * Address review comments and delint.
      
      * Address review comment.
      
      Adding comment for potential performance impact for model on CPU.
      
      * Fix random failure on py3.
      
      * Fix the order of flag saver to avoid the randomness.
      
      The test is broken when the benchmark_logger_type is set first, and
      validated when the benchmark_log_dir is not set yet.
      0270cac7
  3. 03 May, 2018 1 commit