GitLab

This reverts commit 743fe1ab.

* (temporary) add pyyaml to unittest requirements

* add actionable comments

* Add CUDA-11.5 builds to torchvision

* Try to fix cudatoolkit issue

* Trying to use cuda11.5 instead of the toolkit

* Trying to rollback last two changes

* Testing

* Using conda-forge only for cuda115 builds

* Fix typo

* Revert "[FBcode->GH] remove unused requests functionality (#5014)"

This reverts commit 33123bee.

* Revert "replace requests with urllib (#4973)"

This reverts commit 8d25de7b.

* add requests as hard dependency

* install library stubs in CI

* fix syntax

* add requests to conda dependencies

* fix mypy CI

* improve COCO prototype

* test 2017 annotations

* add option to include captions

* fix categories and add tests

* cleanup

* add correct image size to bounding boxes

* fix annotation collation

* appease mypy

* add benchmark

* always use image as reference

* another refactor

* add support for segmentations

* add support for segmentations

* fix CI dependencies

* [DIRTY] cleanup CI config

* remove pip install command

* fix syntax

* fix jobs

* fix syntax

* add support for editable install

* sync

* fix sudo apt install

* fix editable install

* sync

* try pip without user install

* [DIRTY] address review comments

* [DIRTY] try use dynamic name

* switch logic

* address remaining comments

* cleanup

* more cleanup

* fix enabling prototype tests

* Update .circleci/config.yml.in
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* linebreak
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* enable caching of model weights for prototype CI

* syntax

* syntax

* make cache dir dynamic

* increase verbosity

* fix

* use larget CI machine

* revert debug output

* [DEBUG] test env var usage in save_cache

* retry

* use checksum for caching

* remove env vars because expansion is not working

* syntax

* cleanup

* base caching on model-urls

* relax regex

* cleanup skips

* cleanup

* fix skipping logic

* improve step name

* benchmark without caching

* benchmark with external download

* debug

* fix manual download location

* debug again

* download weights in the background

* try parallel download

* add missing import

* use correct decoractor

* up resource_class

* fix wording

* enable stdout passthrough to see download during test

* remove linebreak

* move checkout up

* cleanup

* debug failing test

* temp fix

* fix

* cleanup

* fix regex

* remove explicit install of numpy

Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Set cuversion to 113 for cmake builds

* Build CUDA-11 Windows cmake using C++17

* Cherry-pick pkg_helper changes from pytorch/audio back to vision
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* add tests for builtin prototype datasets

* fix caltech101

* fix emnist

* fix mnist and variants

* add iopath as test requirement

* fix MNIST warning

* fix qmnist data generation

* fix cifar data generation

* add tests for imagenet

* cleanup

* use `store_test_results` for prototype tests

* add failing test

* Revert "add failing test"

This reverts commit ebe2b37cb50461031a94131fe4bd3fae71b48e34.

* improve download nightly pytorch

* update unitest cuda to 11.3

* add nvjpeg in cuda 11.3

* avoid catching exception

* restore to cu111

* Update install.sh

* use conda MatchSpec string

* update linux

* for linux

* Update install.sh
Co-authored-by: Nikita Shulga <nshulga@fb.com>

* add tests for prototype datasets API

* add pytest-mock as test dependency

* remove unnecessary fixtures

* Apply suggestions from code review
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* address first batch of review comments

* remove dynamic class generation

* aggregate similar tests

* split immutable tests once again

* removed unused fixture

* remove re.escape usages

* fix dataset mock
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* Show git diff after lint run

* break both flake8 and ufmt

* Make it run on fail

* Undo breaks and fix job message.

Co-authored-by: Nicolas Hug <nicolashug@fb.com>

* add CI job for prototype tests

* register prototype job

* fix torchvision installation

* fix test invocation

* ignore prototype tests in normal unittests
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

As of https://github.com/pytorch/pytorch/pull/65649 Windows CUDA-10.2
builds are no longer generated, so lets limit it to 11.3 only

* add ufmt as code formatter

* cleanup

* quote ufmt requirement

* split imports into more groups

* regenerate circleci config

* fix CI

* clarify local testing utils section

* use ufmt pre-commit hook

* split relative imports into local category

* Revert "split relative imports into local category"

This reverts commit f2e224cde2008c56c9347c1f69746d39065cdd51.

* pin black and usort dependencies

* fix local test utils detection

* fix ufmt rev

* add reference utils to local category

* fix usort config

* remove custom categories sorting

* Run pre-commit without fixing flake8

* got a double import in merge
Co-authored-by: Nicolas Hug <nicolashug@fb.com>

* add torchdata as prototype dependency

* ignore torchdata for mypy

* move git dependency out of conda environment file

* try unsetting PYTORCH_VERSION env var

* cleanup

* move installation of torchdata after installtion of PyTorch

* regenerate circlci config

* remove branch from torchdata download link
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* enable cuda for unittest

* add one check

* rename

* minor fix

* add more check

* add cuda envs

* add more cuda envs

* add driver update

* update vs integration

* get cuda version

* merge

* add envs in install.sh

* reduce some change and add comments

* minor improve

* fix typo

* exit if driver update failed

* fix lint

* fix lint

* Avoid catching exception to show error message

* try 11.1

* try 11.1

* "try 11.1"

* set the downloaded gpu driver dlls only for 10.2

* check torch.cuda.is_available()

* add display.driver

* Revert "Avoid catching exception to show error message"

This reverts commit 1ce58c50de9fefcc3438d29ff398b941f9b6a757.

* Update .circleci/unittest/windows/scripts/set_cuda_envs.sh

* Update .circleci/unittest/windows/scripts/set_cuda_envs.sh

* Update .circleci/unittest/windows/scripts/set_cuda_envs.sh
Co-authored-by: Nicolas Hug <nicolashug@fb.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>
Co-authored-by: Nikita Shulga <nikita.shulga@gmail.com>
Co-authored-by: Nikita Shulga <nshulga@fb.com>

Old resource class is getting deprecated

* update cuda ver in win cuda unittest

* add -c condaforge to download torch+cu111

* update comments
Co-authored-by: Prabhat Roy <prabhatroy@fb.com>

* add cuda envs

* packaging doesn't need cuda env now

* fix cmake_windows_gpu

* minor fix

* rename suffix

* minor change

* update vs integration

* rm install_cuda_compatible_cmath

* Remove unused script
Co-authored-by: Nicolas Hug <nicolashug@fb.com>
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* add pre-commit hooks

* ignore yamls in packaging/*

* add pre-commit to contributing guide lines

* Update CONTRIBUTING.md
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* remove some hooks

* fix docstrings

* fix end of files
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* Unpinned the libjpeg version and fixed jpeg_mem_dest's size type Windows BC issue

* Temporarily get back pinned jpeg lib in order to run tests on CircleCI

* Revert "Temporarily get back pinned jpeg lib in order to run tests on CircleCI"

This reverts commit ab18a354150f750256b61911e54aa48621ef24cd.

* Used using instead of typedef and Fixed comment typo
Co-authored-by: Zhongkai Zhu <zhongkai@fb.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Add CUDA-11.3 builds to torchvision

Also mark  `.cicrleci/config.yml` as autogenerated in `.gitattributes`

* Add CUDA-11.3 install steps for Windows

* And here as well