GitLab

Summary:
This diff enables ImageNet to be usable from within torchvision.

It implements a different codepath for some families of datasets that can be sharded into multiple pieces, and uses it if within fbcode.

For now all previously supported datasets are also supported (MNIST, CIFAR and FashionMNIST), in addition to ImageNet.

Pull Request resolved: https://github.com/pytorch/vision/pull/4776

Reviewed By: datumbox

Differential Revision: D31929684

fbshipit-source-id: 58f9fe2ed6ce731a6b43a38be912983247eff562
(cherry picked from commit b43fead8ea5164e37637ade0e80477e94f993365)