GitLab

* Initial commit

* pmeiers comments
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* pmeiers changes
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* pmeiers comments
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* replace pandas with system library to avoid crashes

* Lint

* Lint

* fixing unittest

* Minor comments removal

* pmeier comments
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* remove asserts

* address pmeier formatting changes

* address pmeier changes
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* pmeier changes
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* rename n_classes to num_classes

* formatting changes

* doc change to add ".mp4" to backported class

* formatting to correct line length

* adding **kwargs to Kinetics400 class

* remove urlib request and download the file directly

* annotations and files can be already downloaded

* test fix

* add download tests for Kinetics

* users now dont need to provide full path within the root for new Kinetics dataset

* linter

* Update test/test_datasets_download.py

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* revert whitespace (3680#discussion_r626382842)

* addressing annotation_path parameter which is unnecessary

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* kwargs update
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* expose num_download_workers as public

* swap os.isfile with check_integrity

* nit on private things

* special case if there are no default arguments

* revert changes to kinetics400 test case for BC

* add split_folder changes and support for legacy format

* pmeiers suggestions
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* pmeiers suggestions - root comment

* pmeiers comments - annotation attribute remmoved

* pmeiers suggestion
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* pmeiers suggestion
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* pmeiers suggestion
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* pmeiers suggestion
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Update torchvision/datasets/kinetics.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* minor debugging

* nit picks

* only include public kwargs into defaults

* add _use_legacy_structure in favour of **kwargs

* add type hints for Kinetics400

* flake8

* flake8

* flake8

* rename to make thigs clearer

* permuting the output
Co-authored-by: Philip Meier <github.pmeier@posteo.de>
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

Revert "Revert "Ported places365 dataset's tests to the new test framework (#3705)" (#3718)" (#3731)

This reverts commit d4195587.

This reverts commit 4b0b332a.

* Ported places365 dataset's tests to the new test framework

* Made some attributes private

* Removed unnecessary compute_md5()

* Added test_images_download_preexisting()
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Ported STL10 dataset's tests to new test framework

* Added additional tests

* Removed unused import

* Made private methods static and other minor changes

* Ported SVHN dataset to new test framework

* Fixed flake8 error and added REQUIRED_PACKAGES=scipy

* Remove pandas dependecy for CelebA dataset

* address PR comments

* Apply suggestions from code review
Co-authored-by: Philip Meier <github.pmeier@posteo.de>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Added KITTI dataset

* Addressed review comments

* Changed type of target to List[Dict] and corrected the data types of the returned values.

* Updated unit test to rely on ImageDatasetTestCase

* Added kitti to dataset documentation

* Cleaned up test and some minor changes

* Made data_url a string instead of a list

* Removed unnecessary try and print
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* add tests for (Dataset|Image)Folder

* lint

* remove old tests

* cleanup

* more cleanup

* adapt tests

* fix make_dataset

* remove powerset

* readd import

Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* add tests for MNIST and variants

* remove old tests and fakedata generation

* fix default config detection for if dataset has variable keywords

* use split="mnist" as default for EMNIST

* fix QMNIST tests

* lint

* fix special kwargs detection

* Revert "use split="mnist" as default for EMNIST"

This reverts commit 62c9b23597f4a391cad409cbd93edac1b3474acf.

* fix tests

* fix QMNIST test case name

* remove dead code from test

* Revert "remove old tests and fakedata generation"

This reverts commit a285b97c4827566a5bc06c288f5bba8d614a4f7a.

* remove old tests

* readd removed import

* factor out find_classes

* use find_classes in video datasets

* adapt old tests

* added .item() for target inside getitem

* changed fakedataset's expected return type
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* remove caching from (Fashion|K)?MNIST

* remove unnecessary lazy import

* remove false check of binaries against the md5 of archives

* remove caching from EMNIST

* remove caching from QMNIST

* lint

* fix EMNIST

* streamline QMNIST download

* New test for widerface

* linting

* create all 3 folders irrespective of split

* Create different number of images for each split
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* add tests for Flickr8k dataset

* add tests for FLickr30k dataset

* lint
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* add tests for PhotoTour dataset

* fix grayscale image generation

* fix test_feature_types for a examples of a single feature

* make image size variable instead of hard coding it

* make dataset length variable instead of hard coding it

* replace numpy with torch

* fix typo

* add tests for FakeData dataset

* improve skip reason
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* add tests for SEMEION dataset

* add missing imports
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* add tests for HMDB51 dataset

* lint
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* add tests for Kinetics400

* use create_random_string()
Co-authored-by: Philip Meier <pmeier.github@posteo.de>
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

Co-authored-by: vfdev <vfdev.5@gmail.com>
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* make UsageError an Exception rather than RuntimeError

* separate fake data injection and dataset args handling

* adapt tests for Coco

* fix Coco implementation

* add documentation

* fix VideoDatasetTestCase

* adapt UCF101 tests

* cleanup

* allow FileNotFoundError for test without fake data

* Revert "fix Coco implementation"

This reverts commit e2b693881654b3e2462a73e6d22bb01c1b738f8a.

* lint

* fix UCF101 tests

* enable default frames per clips for video test cases

* add tests for UCF101

* remove old tests as well as fake data generation

* better explain frames_per_clip overriding

* lint
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* use common download utils in VOC and SBDataset

* add tests for VOC

* use common base class for VOC datasets

* remove old voc test and fake data generation
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>