• David Yan's avatar
    Add tests for sharded_state_dict and fix compatibility problems · 46606a02
    David Yan authored
    Summary:
    Pull Request resolved: https://github.com/facebookresearch/d2go/pull/511
    
    Add tests for sharded_state_dict integration in AIF Checkpointer
    
    Fix compatibility problems including:
    1. small API errors of flatten_sharded_optim_state_dict
    2. deprecate model.use_local_state_dict and model.load_local_state_dict
    3. fix auto conversion for local_state_dict
    4. fix T148056077: add metadata to differentiate between local_state_dict and sharded_state_dict when loading a directory with FSDPCheckpointer
    
    Reviewed By: YanjunChen329
    
    Differential Revision: D44160045
    
    fbshipit-source-id: f607b7076d0e49b9407f9adfbc8ecfe439c3b0c9
    46606a02
fsdp.py 14.9 KB