• Toby Boyd's avatar
    Transformer v2 benchmark (#6860) · f2ea2f53
    Toby Boyd authored
    * Moved common keras code to utils.
    
    * Initial 1 gpu benchmark
    
    - Aligned flags with resnet example
    - removed code/features that are not super useful
    - eval as part of train if bleu source/ref provided
    - add exp_per_second hook
    
    * Rename benchmark classes, pass batch-size and log_steps.
    
    * fix docstring
    
    * Predict done with checkpoints inline
    
    - perfzero baseclass
    
    * steps not epochs with smoother training loop.
    
    * do not initialize history outside loop.
    
    * 5000 between eval not 500
    
    * estimator to keras.
    
    * remove epochs var.
    
    * use range not xrange.
    
    * 200K steps for 1 gpu
    
    * fix global step
    f2ea2f53
perfzero_benchmark.py 2.52 KB