GitLab

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* [proto] Performance improvements for equalize op

* Added tests

* Removing unnecessary methods/classes.

* Unions instead of ImageOrVideo types

* Fixing JIT issue.

* [proto] Small improvement for tensor equalize op

* Fix code formatting

* Added a comment on the ops

* Change `image_size` to `spatial_size`

* Fix linter

* Fixing more tests.

* Adding get_num_channels_video and get_spatial_size_* kernels for video, masks and bboxes.

* Refactor get_spatial_size

* Reduce the usage of `query_chw` where possible

* Rename `query_chw` to `query_spatial_size`

* Adding `get_num_frames` dispatcher and kernel.

* Adding jit-scriptability tests

* Use the variable name sizes instead of scales for consistency

* Add the missing type hints

* Restore the naming back to scales instead of sizes to avoid backwards incompatibility

* Add video support on MixUp and CutMix

* Switch back to roll

* Fix tests and mypy

* Another mypy fix

* Adding support of Video to missed Transforms and Kernels

* Fixing Grayscale Transform.

* Fixing FiveCrop and TenCrop Transforms.

* Fix Linter

* Fix more kernels.

* Add `five_crop_video` and `ten_crop_video` kernels

* Added a TODO.

* Missed Video isinstance

* nits

* Fix bug on AugMix

* Nits and TODOs.

* Reapply Philip's recommendation

* Fix mypy and JIT

* Fixing test

* Remove performance workaround for mask resize

* Fix linter

* bug fixes

* remove unnecessary import

* Fixing linter

* enable arbitrary batch size for all prototype kernels

* put back perspective dispatcher

* Rewrite `get_dimensions`, `get_num_channels` and `get_spatial_size`

* Remove `get_chw`

* Remove comments

* Make `get_spatial_size` support non-image input

* Reduce the unnecessary use of `get_dimensions*`

* Fix linters

* Fix merge bug

* Linter

* Fix linter

* replace new_like with wrap_like

* fix videos

* revert casting in favor of ignoring mypy

* add video feature

* add video kernels

* add video testing utils

* add one kernel info

* fix kernel names in Video feature

* use only uint8 for video testing

* require at least 4 dims for Video feature

* add TODO for image_size -> spatial_size

* image -> video in feature constructor

* introduce new combined images and video type

* add video to transform utils

* fix transforms test

* fix auto augment

* cleanup

* address review comments

* add remaining video kernel infos

* add batch dimension squashing to some kernels

* fix tests and kernel infos

* add xfails for arbitrary batch sizes on some kernels

* fix test setup

* fix equalize_image_tensor for multi batch dims

* fix adjust_sharpness_image_tensor for multi batch dims

* address review comments

* close streams in prototype datasets

* refactor prototype SBD to avoid closing demux streams at construction time

* mypy

* Fix windows python 3.8

* Update torchvision/extension.py
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Update torchvision/extension.py
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Avoid recommuting the affine matrix in bbox rotate

* Fix linter

* inverted=True for estimating image size

* Update the image size estimation to match the one from the image kernel

* Nits

* Address comments.

* Center=0,0 when expand=true

* pad_image_tensor

* pad_mask and pad_bounding_box

* resize_{image_tensor, mask, bounding_box}

* center_crop_{image_tensor, mask}

* {five, ten}_crop_image_tensor

* crop_{image_tensor, mask}

* convert_color_space_image_tensor

* affine_{image_tensor, mask, bounding_box}

* rotate_{image_tensor, mask}

* gaussian_blur_image_tensor

* cleanup

* Add ValueError

* Add tests for ValueError

* Add tests for ValueError

* Add ValueError

* Change to if/else

* Ammend iou_fn tests

* Move code excerpt

* Format tests
Co-authored-by: Philip Meier <github.pmeier@posteo.de>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Rephrase ONNX RoiAlign warning for aligned=True

* add comma
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

CUB200 dataset in `torchvision.prototype.datasets` module formed labels using file paths. This resulted in labels being 1-indexed (1-200) instead of 0-indexed (0-199). Similar issue occurred with Flowers102 (`torchvision.datasets` module, #5766).

* fix bug in output format for pyav

* add read from memory with constructor overload

* Revert "add read from memory with constructor overload"

This reverts commit 14cbbab239165be05096fd6cbb88cb0448502436.

* run ufmt

* Support exporting RoiAlign align=True to ONNX with opset 16

* lint: ufmt
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* refactor RandomCrop

* mypy

* fix test

* use padding directly rather than private attribute

* only compute type specific fill if padding is needed

* [DRAFT] don't use the diff trick

* fix error message
Co-authored-by: vfdev <vfdev.5@gmail.com>

* remove height and width diff

* reinstate separate diff checking

* introduce needs_crop flag
Co-authored-by: vfdev <vfdev.5@gmail.com>

* prevent feature wrapping for inplace ops

* cleanup

* mypy

* refactor __torch_function__ to be more concise

* avoid double lookup

* fix normalize

* refactor normalize

* mypy

Co-authored-by: vfdev <vfdev.5@gmail.com>

* prevent feature wrapping if the feature is not the primary operand

* explicitly add feature tests to CI

* move metadata computation from prototype features into kernels

* fix tests

* fix no_inplace test

* mypy

* add perf TODO

* Update the expected removal date for several deprecated API

* Revert the change in models/_utils.py

* Remove removal date on pretrained=True

* Update another message related to pretrained=True

* Also update the warning in kwonly_to_pos_or_kw decorator

* Update remaining message in _utils.py

* Hack to improve performance of resize op with nearest mode on 2D

* Moved hack to prototype

* Moved hack into proto and reused code from stable resize

* updates

* More updates

* pass metadata directly after input in prototype kernels

* rename img to image

* Fix `size` in resize.

* Update torchvision/prototype/features/_bounding_box.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Address some of the comments.

* Fix `output_size` in center_crop.

* Fix `CenterCrop` transform

* Fix `size` in five_crop.

* Fix `size` in ten_crop.

* Fix `kernel_size` and `sigma` in gaussian_blur.

* Fix `angle` and `shear` in affine.

* Fixing JIT-scriptability issues.

* Update TODOs.

* Restore fake types for `Union[int, List[int]]` and `Union[int, float, List[float]]`

* Fixing tests

* Fix linter

* revert unnecessary JIT mitigations.

* Cherrypick Philip's 6dfc9657ce89fe9e018a11ee25a8e26c7d3d43c6

* Linter fix

* Adding center float casting
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Remove Kinetics400 class

* Remove '2007-test' in VOC

* Remove some MobileNet layer classes

* Remove torchvision/models/segmentation/segmentation.py

* Remove some MultiScaleRoIAlign methods

* Remove torchvision/transforms/_functional_video.py

* Remove torchvision/transforms/_transforms_video.py

* Remove resample parameter in transforms

* Remove 'range' parameter

* Remove 'fill_value' parameter in transforms

* Revert to original warning for C++ models - looks like we should still keep them around?

* pre-commit

* Fix docs

* Remove test/test_transforms_video.py

* Some fixes

* Remove more tests

* Revert changes to C++ models

* Add back _transforms_video and change warning message

* Change back the warning message, and will change the warning message on separate PR
Co-authored-by: YosuaMichael <yosuamichaelm@gmail.com>
Co-authored-by: Yosua Michael Maranatha <yosuamichael@fb.com>

Co-authored-by: Ambuj Pawar <your_email@abc.example>