• Mansi Mane's avatar
    Smmp batch not divisible by microbatches fix (#10778) · 0282e24e
    Mansi Mane authored
    
    
    * Added debug prints
    
    * Added config
    
    * Added prints
    
    * Added prints
    
    * Added extra samples to SequentialDistributedSampler
    
    * Added extra samples to SequentialDistributedSampler
    
    Updated SequentialDistributedSampler call
    
    * Added deubg prints
    
    * Removed extra prints
    
    * Making predicitons and labels multiple of batchsize
    
    * updated number of microbatches
    
    * Removed extra prints
    
    * Made start_remainder similar to DistributedSamplerWithLoop
    
    * Minor spacing update
    
    * Added debug prints
    
    Added config
    
    Added prints
    
    Added prints
    
    * Added extra samples to SequentialDistributedSampler
    
    Updated SequentialDistributedSampler call
    
    Added extra samples to SequentialDistributedSampler
    
    Added deubg prints
    
    Removed extra prints
    
    Making predicitons and labels multiple of batchsize
    
    updated number of microbatches
    
    Removed extra prints
    
    Squashing redundant commits
    
    * Made start_remainder similar to DistributedSamplerWithLoop
    
    Minor spacing update
    
    Made start_remainder similar to DistributedSamplerWithLoop
    
    * Test and styling
    
    * Rename test
    Co-authored-by: default avatarSylvain Gugger <sylvain.gugger@gmail.com>
    0282e24e
test_trainer_utils.py 8.49 KB