GitLab

* improve perf on convert_image_dtype and add tests

* add reference tests

* use bitshifts for int to int

* revert bitshifts for int to int upscale

* fix warning ignore

* fix, ignore, or assert warnings for consistency tests

* fix, ignore, or assert warnings for kernel infos

* fix to_image_tensor for numpy inputs

* make image from numpy contiguous

* fix test

* Use softmax in _get_gaussian_kernel1d

* Revert "Use softmax in _get_gaussian_kernel1d"

This reverts commit eb8fba36302d2da9e06e6f40afaaf901b276a771.

* Code update

* Relaxed tolerance in consistency tests for GaussianBlur and ElasticTransform

* Code review updates

* Update test_prototype_transforms_consistency.py

* Extend RandomShortestSize to support Video specific flavour of the augmentation

* Adding a test.

* Apply changes from code review

* introduce nearest-exact interpolation

* update prototype tests

* update stable tests

* expand ToDtype to support multiple conversions at once

* simplify

* [proto] Performance improvements for equalize op

* Added tests

* Revert "Add seeds on Kernel Info and reduce randomness for Gaussian Blur (#6741)"

This reverts commit 6e72f2fd

.

* add fixture to fix the RNG seed

* re-add changes to gaussian_blur_* sample input shapes
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Add seeds on Kernel Info and reduce randomness for Gaussian Blur

* Fix linter

* Change `image_size` to `spatial_size`

* Fix linter

* Fixing more tests.

* Adding get_num_channels_video and get_spatial_size_* kernels for video, masks and bboxes.

* Refactor get_spatial_size

* Reduce the usage of `query_chw` where possible

* Rename `query_chw` to `query_spatial_size`

* Adding `get_num_frames` dispatcher and kernel.

* Adding jit-scriptability tests

* Add video support on MixUp and CutMix

* Switch back to roll

* Fix tests and mypy

* Another mypy fix

* Remove performance workaround for mask resize

* Fix linter

* bug fixes

* remove unnecessary import

* Fixing linter

* make args and kwargs in ArgsKwargs more accessible

* refactor KernelInfo and DispatcherInfo

* remove ArgsKwargs __getitem__ shortcut again

* enable arbitrary batch size for all prototype kernels

* put back perspective dispatcher

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* replace new_like with wrap_like

* fix videos

* revert casting in favor of ignoring mypy

* add video feature

* add video kernels

* add video testing utils

* add one kernel info

* fix kernel names in Video feature

* use only uint8 for video testing

* require at least 4 dims for Video feature

* add TODO for image_size -> spatial_size

* image -> video in feature constructor

* introduce new combined images and video type

* add video to transform utils

* fix transforms test

* fix auto augment

* cleanup

* address review comments

* add remaining video kernel infos

* add batch dimension squashing to some kernels

* fix tests and kernel infos

* add xfails for arbitrary batch sizes on some kernels

* fix test setup

* fix equalize_image_tensor for multi batch dims

* fix adjust_sharpness_image_tensor for multi batch dims

* address review comments

* close streams in prototype datasets

* refactor prototype SBD to avoid closing demux streams at construction time

* mypy

* pad_image_tensor

* pad_mask and pad_bounding_box

* resize_{image_tensor, mask, bounding_box}

* center_crop_{image_tensor, mask}

* {five, ten}_crop_image_tensor

* crop_{image_tensor, mask}

* convert_color_space_image_tensor

* affine_{image_tensor, mask, bounding_box}

* rotate_{image_tensor, mask}

* gaussian_blur_image_tensor

* cleanup

* Add ValueError

* Add tests for ValueError

* Add tests for ValueError

* Add ValueError

* Change to if/else

* Ammend iou_fn tests

* Move code excerpt

* Format tests
Co-authored-by: Philip Meier <github.pmeier@posteo.de>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* use pytest markers instead of custom solution for prototype transforms functional tests

* cleanup

* cleanup

* trigger CI

* update test_models.py

* update tests

* fix linting

* fix linting

* add comment

* Trigger CI
Co-authored-by: YosuaMichael <yosuamichael@fb.com>

* Support exporting RoiAlign align=True to ONNX with opset 16

* lint: ufmt
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* refactor RandomCrop

* mypy

* fix test

* use padding directly rather than private attribute

* only compute type specific fill if padding is needed

* [DRAFT] don't use the diff trick

* fix error message
Co-authored-by: vfdev <vfdev.5@gmail.com>

* remove height and width diff

* reinstate separate diff checking

* introduce needs_crop flag
Co-authored-by: vfdev <vfdev.5@gmail.com>

* prevent feature wrapping for inplace ops

* cleanup

* mypy

* refactor __torch_function__ to be more concise

* avoid double lookup

* fix normalize

* refactor normalize

* mypy

* prevent feature wrapping if the feature is not the primary operand

* explicitly add feature tests to CI

* move metadata computation from prototype features into kernels

* fix tests

* fix no_inplace test

* mypy

* add perf TODO

* pass metadata directly after input in prototype kernels

* rename img to image

* Fix `size` in resize.

* Update torchvision/prototype/features/_bounding_box.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Address some of the comments.

* Fix `output_size` in center_crop.

* Fix `CenterCrop` transform

* Fix `size` in five_crop.

* Fix `size` in ten_crop.

* Fix `kernel_size` and `sigma` in gaussian_blur.

* Fix `angle` and `shear` in affine.

* Fixing JIT-scriptability issues.

* Update TODOs.

* Restore fake types for `Union[int, List[int]]` and `Union[int, float, List[float]]`

* Fixing tests

* Fix linter

* revert unnecessary JIT mitigations.

* Cherrypick Philip's 6dfc9657ce89fe9e018a11ee25a8e26c7d3d43c6

* Linter fix

* Adding center float casting
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Revert "Bump tol for autocasted `fasterrcnn_resnet50_fpn` (#6601)"

This reverts commit a4f53308.

* Temporarily remove FasterRCNN autocast test

* Remove Kinetics400 class

* Remove '2007-test' in VOC

* Remove some MobileNet layer classes

* Remove torchvision/models/segmentation/segmentation.py

* Remove some MultiScaleRoIAlign methods

* Remove torchvision/transforms/_functional_video.py

* Remove torchvision/transforms/_transforms_video.py

* Remove resample parameter in transforms

* Remove 'range' parameter

* Remove 'fill_value' parameter in transforms

* Revert to original warning for C++ models - looks like we should still keep them around?

* pre-commit

* Fix docs

* Remove test/test_transforms_video.py

* Some fixes

* Remove more tests

* Revert changes to C++ models

* Add back _transforms_video and change warning message

* Change back the warning message, and will change the warning message on separate PR
Co-authored-by: YosuaMichael <yosuamichaelm@gmail.com>
Co-authored-by: Yosua Michael Maranatha <yosuamichael@fb.com>

* Replace torch.utils.data.graph.traverse with traverse_dps

[ghstack-poisoned]

* Update on "Replace `torch.utils.data.graph.traverse` with `traverse_dps`"


CI is expected to fail for now. This should be merged only after https://github.com/pytorch/pytorch/pull/85667

 has been merged into nightly and internal.



[ghstack-poisoned]
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* add more size types for prototype resize sample inputs

* add skip for dispatcher

* add more sizes to resize kernel info

* add more skips

* add more diversity to gaussian_blur parameters

* diversify affine parameters and fix bounding box kernel

* fix center_crop dispatcher info

* revert kernel fixes

* add skips for scalar shears in affine_bounding_box

Co-authored-by: Ambuj Pawar <your_email@abc.example>

* Ignore deprecation warning from traverse function

* remove only_datapipe

* reinstate warning ignore for DL test

* ignore warning class wide due to priority
Co-authored-by: Philip Meier <github.pmeier@posteo.de>
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>