• Philip Meier's avatar
    Refactor and simplify prototype datasets (#5778) · 1ac6e8b9
    Philip Meier authored
    
    
    * refactor prototype datasets to inherit from IterDataPipe (#5448)
    
    * refactor prototype datasets to inherit from IterDataPipe
    
    * depend on new architecture
    
    * fix missing file detection
    
    * remove unrelated file
    
    * reinstante decorator for mock registering
    
    * options -> config
    
    * remove passing of info to mock data functions
    
    * refactor categories file generation
    
    * fix imagenet
    
    * fix prototype datasets data loading tests (#5711)
    
    * reenable serialization test
    
    * cleanup
    
    * fix dill test
    
    * trigger CI
    
    * patch DILL_AVAILABLE for pickle serialization
    
    * revert CI changes
    
    * remove dill test and traversable test
    
    * add data loader test
    
    * parametrize over only_datapipe
    
    * draw one sample rather than exhaust data loader
    
    * cleanup
    
    * trigger CI
    
    * migrate VOC prototype dataset (#5743)
    
    * migrate VOC prototype dataset
    
    * cleanup
    
    * revert unrelated mock data changes
    
    * remove categories annotations
    
    * move properties to constructor
    
    * readd homepage
    
    * migrate CIFAR prototype datasets (#5751)
    
    * migrate country211 prototype dataset (#5753)
    
    * migrate CLEVR prototype datsaet (#5752)
    
    * migrate coco prototype (#5473)
    
    * migrate coco prototype
    
    * revert unrelated change
    
    * add kwargs to super constructor call
    
    * remove unneeded changes
    
    * fix docstring position
    
    * make kwargs explicit
    
    * add dependencies to docstring
    
    * fix missing dependency message
    
    * Migrate PCAM prototype dataset (#5745)
    
    * Port PCAM
    
    * skip_integrity_check
    
    * Update torchvision/prototype/datasets/_builtin/pcam.py
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    
    * Address comments
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    
    * Migrate DTD prototype dataset (#5757)
    
    * Migrate DTD prototype dataset
    
    * Docstring
    
    * Apply suggestions from code review
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    
    * Migrate GTSRB prototype dataset (#5746)
    
    * Migrate GTSRB prototype dataset
    
    * ufmt
    
    * Address comments
    
    * Apparently mypy doesn't know that __len__ returns ints. How cute.
    
    * why is the CI not triggered??
    
    * Update torchvision/prototype/datasets/_builtin/gtsrb.py
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    
    * migrate CelebA prototype dataset (#5750)
    
    * migrate CelebA prototype dataset
    
    * inline split_id
    
    * Migrate Food101 prototype dataset (#5758)
    
    * Migrate Food101 dataset
    
    * Added length
    
    * Update torchvision/prototype/datasets/_builtin/food101.py
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    
    * Migrate Fer2013 prototype dataset (#5759)
    
    * Migrate Fer2013 prototype dataset
    
    * Update torchvision/prototype/datasets/_builtin/fer2013.py
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    
    * Migrate EuroSAT prototype dataset (#5760)
    
    * Migrate Semeion prototype dataset (#5761)
    
    * migrate caltech prototype datasets (#5749)
    
    * migrate caltech prototype datasets
    
    * resolve third party dependencies
    
    * Migrate Oxford Pets prototype dataset (#5764)
    
    * Migrate Oxford Pets prototype dataset
    
    * Update torchvision/prototype/datasets/_builtin/oxford_iiit_pet.py
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    
    * migrate mnist prototype datasets (#5480)
    
    * migrate MNIST prototype datasets
    
    * Update torchvision/prototype/datasets/_builtin/mnist.py
    Co-authored-by: default avatarNicolas Hug <contact@nicolas-hug.com>
    Co-authored-by: default avatarNicolas Hug <contact@nicolas-hug.com>
    
    * Migrate Stanford Cars prototype dataset (#5767)
    
    * Migrate Stanford Cars prototype dataset
    
    * Address comments
    
    * fix category file generation (#5770)
    
    * fix category file generation
    
    * revert unrelated change
    
    * revert unrelated change
    
    * migrate cub200 prototype dataset (#5765)
    
    * migrate cub200 prototype dataset
    
    * address comments
    
    * fix category-file-generation
    
    * Migrate USPS prototype dataset (#5771)
    
    * migrate SBD prototype dataset (#5772)
    
    * migrate SBD prototype dataset
    
    * reuse categories
    
    * Migrate SVHN prototype dataset (#5769)
    
    * add test to enforce __len__ is working on prototype datasets (#5742)
    
    * reactivate special dataset tests
    
    * add missing annotation
    
    * Cleanup prototype dataset implementation (#5774)
    
    * Remove Dataset2 class
    
    * Move read_categories_file out of DatasetInfo
    
    * Remove FrozenBunch and FrozenMapping
    
    * Remove test_prototype_datasets_api.py and move missing dep test somewhere else
    
    * ufmt
    
    * Let read_categories_file accept names instead of paths
    
    * Mypy
    
    * flake8
    
    * fix category file reading
    Co-authored-by: default avatarPhilip Meier <github.pmeier@posteo.de>
    
    * update prototype dataset README (#5777)
    
    * update prototype dataset README
    
    * fix header level
    
    * Apply suggestions from code review
    Co-authored-by: default avatarNicolas Hug <contact@nicolas-hug.com>
    Co-authored-by: default avatarNicolas Hug <contact@nicolas-hug.com>
    Co-authored-by: default avatarNicolas Hug <contact@nicolas-hug.com>
    1ac6e8b9
builtin_dataset_mocks.py 51.5 KB