• Min Xu's avatar
    FSDP: fixing training with freezing weights (#614) · 24da3b11
    Min Xu authored
    
    
    * FSDP: fixing training with freezing weights
    
    - an assert is changed to catch this case correctly
    - unit test added (based on Quentin's test code) for this case and
      compare DDP and FSDP
    
    fixes: #610
    
    * added test file to list 1
    
    * Use better and simpler code as suggested by Myle
    
    * testing both methods of freezing as well
    Co-authored-by: default avatarMin Xu <min.xu@acm.org>
    24da3b11
test_fsdp_freezing_weights.py 4.07 KB