• Patrick von Platen's avatar
    [Benchmark] Memory benchmark utils (#4198) · 96f57c9c
    Patrick von Platen authored
    
    
    * improve memory benchmarking
    
    * correct typo
    
    * fix current memory
    
    * check torch memory allocated
    
    * better pytorch function
    
    * add total cached gpu memory
    
    * add total gpu required
    
    * improve torch gpu usage
    
    * update memory usage
    
    * finalize memory tracing
    
    * save intermediate benchmark class
    
    * fix conflict
    
    * improve benchmark
    
    * improve benchmark
    
    * finalize
    
    * make style
    
    * improve benchmarking
    
    * correct typo
    
    * make train function more flexible
    
    * fix csv save
    
    * better repr of bytes
    
    * better print
    
    * fix __repr__ bug
    
    * finish plot script
    
    * rename plot file
    
    * delete csv and small improvements
    
    * fix in plot
    
    * fix in plot
    
    * correct usage of timeit
    
    * remove redundant line
    
    * remove redundant line
    
    * fix bug
    
    * add hf parser tests
    
    * add versioning and platform info
    
    * make style
    
    * add gpu information
    
    * ensure backward compatibility
    
    * finish adding all tests
    
    * Update src/transformers/benchmark/benchmark_args.py
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    
    * Update src/transformers/benchmark/benchmark_args_utils.py
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    
    * delete csv files
    
    * fix isort ordering
    
    * add out of memory handling
    
    * add better train memory handling
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    96f57c9c
plot_csv_file.py 4.08 KB