GitLab

* Add benchmark upload util to bigquery.

Also update the benchmark logger and bigquery schema for the
errors found during the integration test.

* Fix lint error.

* Update test to clear all the env vars during test.

This was causing error since the Kokoro test has TF_PKG=tf-nightly
injected during test.

* Update lintrc to ignore google related package.

* Another attempt to fix lint import error.

* Address the review comment.

* Fix lint error.

* Another fix for lint.

* Update test comment for env var clean up.

* Update the importing logic for cpuinfo and psutil.

Those two libs are usually not installed by default, and we should
not force people to install them if they just want to run resnet.

* Add pylint warning suppression.

* add requirements.txt now that there are dependencies beyond tensorflow

* direct pip info to README

* Init test for logging benchmark run.

* Fix collect CPU info.

* Update max split for handling GPU information.

* Another fix for parse GPU info.

* Fix GPU and CPU info collector.

* Update logging function to be static.

* Remove the cifar10 logging and fix a lint error.

* Address the review comment.

* Fix lint error.

* Fix lint error for logger and logger_test.

* Another lint fix for the test.

* Simplify the CPU info logging.

We will start in a conserative way, and probably add more info in
future.

* Remove unused dependencies.

* Update reset model for benchmark logging.

To enable benchmark logging, just add "--hooks LoggingMetricHook"

* Benchmark logger fix for resnet.

1. Update default at_end to False for metric logger to avoid
checkpoint error.
2. Update resnet run to log final evaluation result.

* Update log output for final eval_result.

* Typo fix.

* Unset the default value for benchmark_log_dir.

Usually the benchmark should be logged to different directly for
each run. Having a default value will hide the choice from user.

* Bug fix for benchmark logger initialization.

* Fix lint error.

* Address the review comment.

1. Update the logger to cover evaluation result.
2. Move the flag to performance parser.

* Undo the change for arg_parser.

* Add session hook for benchmark metric logging.

Current hook is very similar as the LoggingTensorHook. Some of the
function are directly copied since the original one was not
exposed for import. We should seek to eventually move this code to
core when it is mature enough.

* Update metric_hook to use LoggingTensorHook as base.

The existing hook is similar enough to LoggingTensorHook, and
we should eliminate duplicate as much as possible.

* Address review comment.

1. Update global step tensor handle.
2. Update tests.
3. Update document.

* Update tests for py3.

* Fix lint error

* Glint everything

* Adding rcfile and pylinting

* Extra newline

* Few last lints

Use util functions hooks_helper and parser in mnist and wide_deep, and rename epochs_between_eval (from epochs_per_eval) (#3650)

* Update resnet with logging utils

* intermediate commit

* commit before rebase from master

* Add tests of ExamplePerSecondHook

* Done with test

* Fix a style nit

* Fix a style nit

* Removing dependency on tf.test

* New lines

* Adding logging utils

* restore utils

* delete old file

* update inputs and docstrings

* Update import and fix typos

* Fix formatting and comments

* Update tests