• anj-s's avatar
    [benchmarks] Add benchmarks for FSDP (#765) · f9a125db
    anj-s authored
    * add benchmarks for fsdp
    
    * fix lint errors
    
    * clean up
    
    * clean up unused flags
    
    * add the benchmarks
    
    * remove unused args
    
    * fix lint errors
    
    * fix lint errors
    
    * update command line
    
    * add support for multiple devices
    
    * try full fp16 mode
    
    * try full fp16 mode
    
    * lint errors
    
    * merge main
    
    * lint errors
    
    * lint errors
    
    * lint error
    
    * update intersphinx mapping for numpy
    
    * update intersphinx mapping for numpy
    
    * skip test
    
    * added golden configs
    
    * use synthetic benchmarks
    
    * fix fn name
    
    * fix cuda device id
    
    * fix verify
    
    * lint fix
    f9a125db
fsdp.py 14.3 KB