GitLab

* Test: add backend parameter

* VideoReader object now works on backend

* Frame reading now passes

* Keyframe seek now passes

* Pyav backend now supports metadata

* changes in test to reflect GPU decoder change

* Linter?

* Test GPU output

* Addressing Joao's comments

* lint

* lint

* Revert "Test GPU output"

This reverts commit f62e955d7dc81bcb23b40d58ea75413b9b62e76d.

* lint?

* lint

* lint

* Address issues in build?

* hopefully doc fix

* Arrgh

* arrgh

* fix typos

* fix input options

* remove read from memory option in pyav

* skip read from mem test for gpu and pyab be

* fix test

* remove unused import

* Hack to get reading from memory work with pyav

* patch audio test
Co-authored-by: Bruno Korbar <bkorbar@quansight.com>
Co-authored-by: Joao Gomes <jdsgomes@fb.com>

* [Nova] More comprehensive Smoke Tests for Torchvision

* No need to import everything since nothing is lazily uploaded

* fix reference tests for convert_format_bounding_box

* add check to prevent empty args_kwargs_fns in the future

* extend support of posterize to all integer and floating dtypes

* remove raise

* revert to fixed value range for integer dtypes

* extend equalize to all integer and floating dtypes

* address nits

* Change random generator for ColorJitter.

* Move `_convert_fill_arg` from runtime to constructor.

* Remove unnecessary TypeVars.

* Remove unnecessary casts

* Update comments.

* Minor code-quality changes on Geometical Transforms.

* Fixing linter and other minor fixes.

* Change mitigation for mypy.`

* Fixing the tests.

* Fixing the tests.

* Fix linter

* Restore dict copy.

* Handling of defaultdicts

* restore int idiom

* Update todo

* ignore git warning 'globally'

* improve comment

* Adding temporal sampling kernel and dispatcher.

* Adding the UniformTemporalSubsample class.

* Add it on init

* Adding tests.

* Addressing comments.

* Reverting proposal as it led to different results.

* add more tests for uniform_temporal_subsample

* cleanup

* fix logic

* fix logic

* make test more strict

* lint

* Update torchvision/prototype/transforms/functional/_temporal.py

* remove pytorchvideo again per request
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* add KernelInfo

* split dtype and device consistency tests

* add proper support for video

* fix tests and add DispatcherInfo

* add aliases

* cleanup

* fix typo

* remove copy from convert_color_space

* remove copy from convert_format_bounding_box

* remove .to_* methods from features

* remove unnecessary clones

* add perf todos

* refactor convert_color_space

* lint

* remove another clone

* and another clone

* remove a missed copy

This reverts commit d0de55db.

* Add PermuteDimensions and TransposeDimensions transforms

* Strip Subclass info.

* Apply changes from code review.

* [proto][WIP] Enable GPU tests on prototype

* Update prototype-tests.yml

* tests on gpu as separate file

* Removed matrix setup

* Update prototype-tests-gpu.yml

* Update prototype-tests-gpu.yml

* Added --gpus=all flag

* Added xfail for cuda vs cpu tolerance issue

* Update prototype-tests-gpu.yml

* perf improvements for equalize
Co-authored-by: lezcano <lezcano-93@hotmail.com>

* improve reference tests

* add extensive comments and minor fixes to the kernel

* improve comments
Co-authored-by: lezcano <lezcano-93@hotmail.com>

* WIP

* _blend optim v1

* _blend and color ops optims: v2

* updated a/r tol and configs to make tests pass

* Loose a/r tolerance in AA tests

* Use custom rgb_to_grayscale

* Renamed img -> image

* nit code update

* PR review

* adjust_contrast convert to float32 earlier

* Revert "adjust_contrast convert to float32 earlier"

This reverts commit a82cf8c739d02acd9868ebee4b8b99d101c3e45e.

* add tensor as optional param

* add init from memory

* fix bug

* fix bug

* first working version

* apply formatting and add tests

* simplify tests

* fix tests

* fix wrong variable name

* add path as optional parameter

* add src as optional

* address pr comments

* Fix warning messages

* address pr comments

* make tests stricter

* Revert "make tests stricter"

This reverts commit 6c92e94e8372f381c9496c9f885c2c71b6a4356b.

* improve perf on convert_image_dtype and add tests

* add reference tests

* use bitshifts for int to int

* revert bitshifts for int to int upscale

* fix warning ignore

* fix, ignore, or assert warnings for consistency tests

* fix, ignore, or assert warnings for kernel infos

* fix to_image_tensor for numpy inputs

* make image from numpy contiguous

* fix test

* Use softmax in _get_gaussian_kernel1d

* Revert "Use softmax in _get_gaussian_kernel1d"

This reverts commit eb8fba36302d2da9e06e6f40afaaf901b276a771.

* Code update

* Relaxed tolerance in consistency tests for GaussianBlur and ElasticTransform

* Code review updates

* Update test_prototype_transforms_consistency.py

* Extend RandomShortestSize to support Video specific flavour of the augmentation

* Adding a test.

* Apply changes from code review

* introduce nearest-exact interpolation

* update prototype tests

* update stable tests

* expand ToDtype to support multiple conversions at once

* simplify

* [proto] Performance improvements for equalize op

* Added tests

* Revert "Add seeds on Kernel Info and reduce randomness for Gaussian Blur (#6741)"

This reverts commit 6e72f2fd

.

* add fixture to fix the RNG seed

* re-add changes to gaussian_blur_* sample input shapes
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Add seeds on Kernel Info and reduce randomness for Gaussian Blur

* Fix linter

* Change `image_size` to `spatial_size`

* Fix linter

* Fixing more tests.

* Adding get_num_channels_video and get_spatial_size_* kernels for video, masks and bboxes.

* Refactor get_spatial_size

* Reduce the usage of `query_chw` where possible

* Rename `query_chw` to `query_spatial_size`

* Adding `get_num_frames` dispatcher and kernel.

* Adding jit-scriptability tests

* Add video support on MixUp and CutMix

* Switch back to roll

* Fix tests and mypy

* Another mypy fix

* Remove performance workaround for mask resize

* Fix linter

* bug fixes

* remove unnecessary import

* Fixing linter

* make args and kwargs in ArgsKwargs more accessible

* refactor KernelInfo and DispatcherInfo

* remove ArgsKwargs __getitem__ shortcut again

* enable arbitrary batch size for all prototype kernels

* put back perspective dispatcher

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* replace new_like with wrap_like

* fix videos

* revert casting in favor of ignoring mypy

* add video feature

* add video kernels

* add video testing utils

* add one kernel info

* fix kernel names in Video feature

* use only uint8 for video testing

* require at least 4 dims for Video feature

* add TODO for image_size -> spatial_size

* image -> video in feature constructor

* introduce new combined images and video type

* add video to transform utils

* fix transforms test

* fix auto augment

* cleanup

* address review comments

* add remaining video kernel infos

* add batch dimension squashing to some kernels

* fix tests and kernel infos

* add xfails for arbitrary batch sizes on some kernels

* fix test setup

* fix equalize_image_tensor for multi batch dims

* fix adjust_sharpness_image_tensor for multi batch dims

* address review comments

* close streams in prototype datasets

* refactor prototype SBD to avoid closing demux streams at construction time

* mypy

* pad_image_tensor

* pad_mask and pad_bounding_box

* resize_{image_tensor, mask, bounding_box}

* center_crop_{image_tensor, mask}

* {five, ten}_crop_image_tensor

* crop_{image_tensor, mask}

* convert_color_space_image_tensor

* affine_{image_tensor, mask, bounding_box}

* rotate_{image_tensor, mask}

* gaussian_blur_image_tensor

* cleanup