• atturaioe's avatar
    Add AnyPrecisionAdamW optimizer (#18961) · 84c9cc6d
    atturaioe authored
    * Add AnyPrecisionAdamW optimizer
    
    * Add optim_args argument to TrainingArgs
    
    * Add tests for AnyPrecisionOptimizer
    
    * Change AnyPrecisionAdam default params to float32
    
    * Move default_anyprecision_kwargs in trainer test
    
    * Rename AnyPrecisionAdamW
    84c9cc6d
trainer.py 172 KB