GitLab

Cherry-pick pkg_helper changes from https://github.com/pytorch/audio/commit/0f8443050bd6ce402f939ef6876fccf1a2dacf16 (#4944)

Add CUDA_HOME to PATH to fix Cmake builds
Define `FORCE_CUDA` only when CUDA_PATH is present (or if RocM)

Co-authored-by: Nikita Shulga <nshulga@fb.com>

Co-authored-by: Nicolas Hug <nicolashug@fb.com>

Relocate fails to find nvjpeg unless its present in the library search path.

* fix cuda installation failure in packaging

* rm stop windows upgrade

* Update cuda_install.bat
Co-authored-by: Nikita Shulga <nshulga@fb.com>

GPU tests have special step to install the driver, CUDA install step shouldl just install the runtime
never

Fixes regression introduced by https://github.com/pytorch/vision/pull/4421

* Move TorchVision conda package to use pytorch-mutex

This is follow up after https://github.com/pytorch/builder/pull/823

 that gets rids of `feature` and migrate it to `run_constrained`

* Update packaging/torchvision/meta.yaml
Co-authored-by: Eli Uriegas <1700823+seemethere@users.noreply.github.com>

* Update packaging/torchvision/meta.yaml
Co-authored-by: Eli Uriegas <1700823+seemethere@users.noreply.github.com>
Co-authored-by: Eli Uriegas <1700823+seemethere@users.noreply.github.com>

Co-authored-by: Jane (Yuan) Xu <31798555+janeyx99@users.noreply.github.com>

* add ufmt as code formatter

* cleanup

* quote ufmt requirement

* split imports into more groups

* regenerate circleci config

* fix CI

* clarify local testing utils section

* use ufmt pre-commit hook

* split relative imports into local category

* Revert "split relative imports into local category"

This reverts commit f2e224cde2008c56c9347c1f69746d39065cdd51.

* pin black and usort dependencies

* fix local test utils detection

* fix ufmt rev

* add reference utils to local category

* fix usort config

* remove custom categories sorting

* Run pre-commit without fixing flake8

* got a double import in merge
Co-authored-by: Nicolas Hug <nicolashug@fb.com>

* enable cuda for unittest

* add one check

* rename

* minor fix

* add more check

* add cuda envs

* add more cuda envs

* add driver update

* update vs integration

* get cuda version

* merge

* add envs in install.sh

* reduce some change and add comments

* minor improve

* fix typo

* exit if driver update failed

* fix lint

* fix lint

* Avoid catching exception to show error message

* try 11.1

* try 11.1

* "try 11.1"

* set the downloaded gpu driver dlls only for 10.2

* check torch.cuda.is_available()

* add display.driver

* Revert "Avoid catching exception to show error message"

This reverts commit 1ce58c50de9fefcc3438d29ff398b941f9b6a757.

* Update .circleci/unittest/windows/scripts/set_cuda_envs.sh

* Update .circleci/unittest/windows/scripts/set_cuda_envs.sh

* Update .circleci/unittest/windows/scripts/set_cuda_envs.sh
Co-authored-by: Nicolas Hug <nicolashug@fb.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>
Co-authored-by: Nikita Shulga <nikita.shulga@gmail.com>
Co-authored-by: Nikita Shulga <nshulga@fb.com>

`import torchvision` fails if numpy is not installed, so it should have
an explicit dependency on it (which is already the case for wheel
package)

* add cuda envs

* packaging doesn't need cuda env now

* fix cmake_windows_gpu

* minor fix

* rename suffix

* minor change

* update vs integration

* if there's dll, overwrite it

* temp change

* revert last
Co-authored-by: Nikita Shulga <nshulga@fb.com>

* add pre-commit hooks

* ignore yamls in packaging/*

* add pre-commit to contributing guide lines

* Update CONTRIBUTING.md
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* remove some hooks

* fix docstrings

* fix end of files
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* Add deprecation warnings on vision::models

* Change the C++ example.

* Chage readme.

* Update deprecation warning.

* Unpinned the libjpeg version and fixed jpeg_mem_dest's size type Windows BC issue

* Temporarily get back pinned jpeg lib in order to run tests on CircleCI

* Revert "Temporarily get back pinned jpeg lib in order to run tests on CircleCI"

This reverts commit ab18a354150f750256b61911e54aa48621ef24cd.

* Used using instead of typedef and Fixed comment typo
Co-authored-by: Zhongkai Zhu <zhongkai@fb.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Add CUDA-11.3 builds to torchvision

Also mark  `.cicrleci/config.yml` as autogenerated in `.gitattributes`

* Add CUDA-11.3 install steps for Windows

* And here as well

* fix MacOS cmake workflow

* try only mkl

* only pin mkl on MacOs

* fix
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

Co-authored-by: Nicolas Hug <nicolashug@fb.com>

* Do not install lame when building torchvision

It is needed only for ffmpeg integration, which is disabled anyway

* Also upgrade setuptool

To update pkg_resources.packaging to version 20.0+

* packaging: Remove special versioning priveleges

Adds a version suffix for CUDA 10.2 for ease of installing when
installing from download.pytorch.org
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

* also include windows cmath fix
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

* remove comment
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

* fix indent
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

* actually add the script
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

* Fix inconsistent version pinning across yaml files.

* Pin pillow to >=5.3.0

* Pin pillow>=5.3.0 everywhere

* hello

* Try with DYLD_FALLBACK_LIBRARY_PATH
Co-authored-by: Edgar Andrés Margffoy Tuay <andfoy@gmail.com>

* packaging: Remove pin for jpeg, numpy

These may no longer be necessary due to the default anaconda channel
having the necessary packages now.
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

* Update packaging/torchvision/meta.yaml
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* remove some files

* Also remove entire packaging/conda folder
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* trying stuff

* Put flags back?

* remove second one just to see

* It worked but it's because it's not built by CI. Trying another one

* Try using TORCH_CUDA_ARCH_LIST instead

* oops

* Add new env variable to build/script_env

* set TORCH_CUDA_ARCH_LIST for the rest of the CUDA versions

* don't pass NVCC_FLAGS venv to conda, let's see if it works
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* add ROCm binary wheels

* fix lint error
Co-authored-by: Eli Uriegas <1700823+seemethere@users.noreply.github.com>
Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

(cherry picked from commit 2f40a483d73018ae6e1488a484c5927f2b309969)
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Co-authored-by: Francisco Massa <fvsmassa@gmail.com>

* Speedup test_ucf101 (#2623 

* Speedup Cmake builds (#3186)

* Speedup test_autoaugment (#3190)

* Speedup DeformConvTester (#3191)

* Speedup InceptionV3 and GoogleNet on Windows (#3196)

Replace tabs with spaces, add newlines to files and replace whitelist with allowlist

This was a mistake since version suffix should always be appended
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>
(cherry picked from commit 6631b74db7cf8aebee8af196b4c65b1fce220baa)
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>