GitLab

* add Windows and macOS CI jobs for prototype tests

* fix CircleCI config

* cleanup

* use 3.8 as base to surface errors

* try using bash explicitly

* cleanup

* try test reports

* debug

* disable CircleCI

* add write permissions for write

* expand permissions

* try move permissions on job rather than global

* debug

* always debug

* maximum permissions

* cleanup

* cleanup

Co-authored-by: Nikita Shulga <nshulga@fb.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

As Ubuntu-1604 runners will no longer be available in early May 2022
Update `ubuntu-1604:201903-01` to `ubuntu-2004:202104-01`
and `ubuntu-1604-cuda-10.2:202012-01` to `ubuntu-2004-cuda-11.4:202110-01`
Per [CircleCI Configuration reference](https://circleci.com/docs/2.0/configuration-reference/)

Signed-off-by: Kyle Chen <kylechen@amd.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* upgrade to next-gen CircleCI convenience images

* [DEBUG] try latest Android NDK convenience image

* [DEBUG] try earliest next-gen android image

* Moving basefiles outside of prototype and porting Alexnet, ConvNext, Densenet and EfficientNet.

* Porting googlenet

* Porting inception

* Porting mnasnet

* Porting mobilenetv2

* Porting mobilenetv3

* Porting regnet

* Porting resnet

* Porting shufflenetv2

* Porting squeezenet

* Porting vgg

* Porting vit

* Fix docstrings

* Fixing imports

* Adding missing import

* Fix mobilenet imports

* Fix tests

* Fix prototype tests

* Exclude get_weight from models on test

* Fix init files

* Porting googlenet

* Porting inception

* porting mobilenetv2

* porting mobilenetv3

* porting resnet

* porting shufflenetv2

* Fix test and linter

* Fixing docs.

* Porting Detection models (#5617)

* fix inits

* fix docs

* Port faster_rcnn

* Port fcos

* Port keypoint_rcnn

* Port mask_rcnn

* Port retinanet

* Port ssd

* Port ssdlite

* Fix linter

* Fixing tests

* Fixing tests

* Fixing vgg test

* Porting Optical Flow, Segmentation, Video models (#5619)

* Porting raft

* Porting video resnet

* Porting deeplabv3

* Porting fcn and lraspp

* Fixing the tests and linter

* Porting docs, examples, tutorials and galleries (#5620)

* Fix examples, tutorials and gallery

* Update gallery/plot_optical_flow.py
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* Fix import

* Revert hardcoded normalization

* fix uncommitted changes

* Fix bug

* Fix more bugs

* Making resize optional for segmentation

* Fixing preset

* Fix mypy

* Fixing documentation strings

* Fix flake8

* minor refactoring
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* Resolve conflict

* Porting model tests (#5622)

* Porting tests

* Remove unnecessary variable

* Fix linter

* Move prototype to extended tests

* Fix download models job

* Update CI on Multiweight branch to use the new weight download approach (#5628)

* port Pad to prototype transforms (#5621)

* port Pad to prototype transforms

* use literal

* Bump up LibTorchvision version number for Podspec to release Cocoapods (#5624)
Co-authored-by: Anton Thomma <anton@pri.co.nz>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* pre-download model weights in CI docs build (#5625)

* pre-download model weights in CI docs build

* move changes into template

* change docs image

* Regenerated config.yml
Co-authored-by: Philip Meier <github.pmeier@posteo.de>
Co-authored-by: Anton Thomma <11010310+thommaa@users.noreply.github.com>
Co-authored-by: Anton Thomma <anton@pri.co.nz>

* Porting reference scripts and updating presets (#5629)

* Making _preset.py classes

* Remove support of targets on presets.

* Rewriting the video preset

* Adding tests to check that the bundled transforms are JIT scriptable

* Rename all presets from *Eval to *Inference

* Minor refactoring

* Remove --prototype and --pretrained from reference scripts

* remove  pretained_backbone refs

* Corrections and simplifications

* Fixing bug

* Fixing linter

* Fix flake8

* restore documentation example

* minor fixes

* fix optical flow missing param

* Fixing commands

* Adding weights_backbone support in detection and segmentation

* Updating the commands for InceptionV3

* Setting `weights_backbone` to its fully BC value (#5653)

* Replace default `weights_backbone=None` with its BC values.

* Fixing tests

* Fix linter

* Update docs.

* Update preprocessing on reference scripts.

* Change qat/ptq to their full values.

* Refactoring preprocessing

* Fix video preset

* No initialization on VGG if pretrained

* Fix warning messages for backbone utils.

* Adding star to all preset constructors.

* Fix mypy.
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>
Co-authored-by: Philip Meier <github.pmeier@posteo.de>
Co-authored-by: Anton Thomma <11010310+thommaa@users.noreply.github.com>
Co-authored-by: Anton Thomma <anton@pri.co.nz>

* pre-download model weights in CI docs build

* move changes into template

* change docs image

* fix documentation version problems

* add missing import

* linting

* Dsiabling smoke test for nightly builds

* fix lint
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

Also, remove reference to conda-forge, all CUDA toolchain should be
available from NVIDIA channel

Install h5py from pip on Windows and skip failing gaussian_blur tests if Win+CUDA11.3 is used

* Revert "disable ufmt pre-commit hook (#5454)"

This reverts commit 9301685a.

* upgrade ufmt to 1.3.2

* disable ufmt pre-commit hook

* run ufmt outside of pre-commit

* Add Python-3.10 (build and test)

* Fix functional.adjust_gamma
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>
Co-authored-by: Joao Gomes <joaopsgomes@gmail.com>

* Add PCAM dataset to prototype area

* use BytesIO instead of writing file to disk

* Apply suggestions from code review
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* remove noqa

* typos

* Use _Resource namedtuple

* Add h5py to unittest_prototype job

* use .item() on target

* Forgot to call regenerate.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>
Co-authored-by: Nikita Shulga <nshulga@fb.com>

* Add CUDA-11.5 builds to torchvision

* Try to fix cudatoolkit issue

* Trying to use cuda11.5 instead of the toolkit

* Trying to rollback last two changes

* Testing

* Using conda-forge only for cuda115 builds

* Fix typo

* Revert "[FBcode->GH] remove unused requests functionality (#5014)"

This reverts commit 33123bee.

* Revert "replace requests with urllib (#4973)"

This reverts commit 8d25de7b.

* add requests as hard dependency

* install library stubs in CI

* fix syntax

* add requests to conda dependencies

* fix mypy CI

* improve COCO prototype

* test 2017 annotations

* add option to include captions

* fix categories and add tests

* cleanup

* add correct image size to bounding boxes

* fix annotation collation

* appease mypy

* add benchmark

* always use image as reference

* another refactor

* add support for segmentations

* add support for segmentations

* fix CI dependencies

* [DIRTY] cleanup CI config

* remove pip install command

* fix syntax

* fix jobs

* fix syntax

* add support for editable install

* sync

* fix sudo apt install

* fix editable install

* sync

* try pip without user install

* [DIRTY] address review comments

* [DIRTY] try use dynamic name

* switch logic

* address remaining comments

* cleanup

* more cleanup

* fix enabling prototype tests

* Update .circleci/config.yml.in
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* linebreak
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* enable caching of model weights for prototype CI

* syntax

* syntax

* make cache dir dynamic

* increase verbosity

* fix

* use larget CI machine

* revert debug output

* [DEBUG] test env var usage in save_cache

* retry

* use checksum for caching

* remove env vars because expansion is not working

* syntax

* cleanup

* base caching on model-urls

* relax regex

* cleanup skips

* cleanup

* fix skipping logic

* improve step name

* benchmark without caching

* benchmark with external download

* debug

* fix manual download location

* debug again

* download weights in the background

* try parallel download

* add missing import

* use correct decoractor

* up resource_class

* fix wording

* enable stdout passthrough to see download during test

* remove linebreak

* move checkout up

* cleanup

* debug failing test

* temp fix

* fix

* cleanup

* fix regex

* remove explicit install of numpy

Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Set cuversion to 113 for cmake builds

* Build CUDA-11 Windows cmake using C++17

* Cherry-pick pkg_helper changes from pytorch/audio back to vision
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* add tests for builtin prototype datasets

* fix caltech101

* fix emnist

* fix mnist and variants

* add iopath as test requirement

* fix MNIST warning

* fix qmnist data generation

* fix cifar data generation

* add tests for imagenet

* cleanup

* use `store_test_results` for prototype tests

* add failing test

* Revert "add failing test"

This reverts commit ebe2b37cb50461031a94131fe4bd3fae71b48e34.

* add tests for prototype datasets API

* add pytest-mock as test dependency

* remove unnecessary fixtures

* Apply suggestions from code review
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* address first batch of review comments

* remove dynamic class generation

* aggregate similar tests

* split immutable tests once again

* removed unused fixture

* remove re.escape usages

* fix dataset mock
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* Show git diff after lint run

* break both flake8 and ufmt

* Make it run on fail

* Undo breaks and fix job message.

* add CI job for prototype tests

* register prototype job

* fix torchvision installation

* fix test invocation

* ignore prototype tests in normal unittests
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

As of https://github.com/pytorch/pytorch/pull/65649 Windows CUDA-10.2
builds are no longer generated, so lets limit it to 11.3 only