1. 04 Mar, 2021 1 commit
  2. 03 Mar, 2021 3 commits
  3. 02 Mar, 2021 5 commits
  4. 01 Mar, 2021 2 commits
  5. 28 Feb, 2021 1 commit
    • Jcaw's avatar
      Apply functional batch consistency tests to batches of different items (#1315) · 3047dc9b
      Jcaw authored
      * Test with batches of differing items
      
      Issues that occur when different items in a batch influence one another
      will not present when a batch is composed of identical items. When
      checking the consistency of batched behavior, in order to catch these
      issues items should be different.
      
      Thus, use different items for the `functional` batch consistency tests
      wherever possible.
      
      * Generate different white noise in each channel
      
      Don't duplicate a single channel multiple times. Since this is used for
      testing, generate different noise in each channel so data leakage
      between channels can be detected.
      
      * Parameterize batch size in batch consistency tests
      
      Rather than creating a batch of 3 items in each test and slicing it to
      test two different batch sizes at once, parameterize the batch size on
      the TestFunctional class itself. This will generate a separate set of
      tests for each batch size (better isolating failures) and removes a
      leaky abstraction where the test calling `assert_batch_consistencies`
      had to know to give it a batch size greater than 1.
      
      * Check inputs too, to catch in-place operations
      
      Check inputs to the batch consistency operations too, to ensure any
      in-place operations operate the same on items as batches - not just that
      they output the same result.
      
      * Use much shorter sample for phaser test
      
      Using a 5-second signal for the phaser test takes a long time on CPU,
      much longer than the other batch consistency tests. Use a shorter signal
      instead.
      
      * Load dual-channel wav for VAD test
      
      The stereo wav has two channels, slightly offset, so they'll count as
      different items.
      
      * Load wav using common_utils, not torchaudio.load
      
      * Test pitch frequency with different freqs per item
      
      The pitch frequency batch test was using the same frequency for each
      item, which may not catch data leakage between items within a batch. Use
      different frequencies so these kinds of issues would be triggered, just
      like the other batch consistency tests.
      
      * Explain justification for single-item batch
      3047dc9b
  6. 26 Feb, 2021 4 commits
  7. 24 Feb, 2021 3 commits
  8. 23 Feb, 2021 5 commits
  9. 22 Feb, 2021 1 commit
  10. 21 Feb, 2021 1 commit
  11. 20 Feb, 2021 3 commits
  12. 19 Feb, 2021 4 commits
  13. 18 Feb, 2021 1 commit
  14. 17 Feb, 2021 1 commit
  15. 16 Feb, 2021 1 commit
  16. 15 Feb, 2021 4 commits