GitLab

Co-authored-by: Nicolas Hug <nicolashug@meta.com>
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>
Co-authored-by: vfdev-5 <vfdev.5@gmail.com>

Co-authored-by: Nikita Shulga <nshulga@fb.com>

* rename features._Feature to datapoints.Datapoint

* _Datapoint to Datapoint

* move is_simple_tensor to transforms.utils

* fix CI

* move Datapoint out of public namespace

* expose some prototype transforms utils

* rename _isinstance

* Change random generator for ColorJitter.

* Move `_convert_fill_arg` from runtime to constructor.

* Remove unnecessary TypeVars.

* Remove unnecessary casts

* Update comments.

* Minor code-quality changes on Geometical Transforms.

* Fixing linter and other minor fixes.

* Change mitigation for mypy.`

* Fixing the tests.

* Fixing the tests.

* Fix linter

* Restore dict copy.

* Handling of defaultdicts

* restore int idiom

* Update todo

* Add PermuteDimensions and TransposeDimensions transforms

* Strip Subclass info.

* Apply changes from code review.

* Change `image_size` to `spatial_size`

* Fix linter

* Fixing more tests.

* Adding get_num_channels_video and get_spatial_size_* kernels for video, masks and bboxes.

* Refactor get_spatial_size

* Reduce the usage of `query_chw` where possible

* Rename `query_chw` to `query_spatial_size`

* Adding `get_num_frames` dispatcher and kernel.

* Adding jit-scriptability tests

* Rewrite `get_dimensions`, `get_num_channels` and `get_spatial_size`

* Remove `get_chw`

* Remove comments

* Make `get_spatial_size` support non-image input

* Reduce the unnecessary use of `get_dimensions*`

* Fix linters

* Fix merge bug

* Linter

* Fix linter

* add video feature

* add video kernels

* add video testing utils

* add one kernel info

* fix kernel names in Video feature

* use only uint8 for video testing

* require at least 4 dims for Video feature

* add TODO for image_size -> spatial_size

* image -> video in feature constructor

* introduce new combined images and video type

* add video to transform utils

* fix transforms test

* fix auto augment

* cleanup

* address review comments

* add remaining video kernel infos

* add batch dimension squashing to some kernels

* fix tests and kernel infos

* add xfails for arbitrary batch sizes on some kernels

* fix test setup

* fix equalize_image_tensor for multi batch dims

* fix adjust_sharpness_image_tensor for multi batch dims

* address review comments

* Fix `size` in resize.

* Update torchvision/prototype/features/_bounding_box.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Address some of the comments.

* Fix `output_size` in center_crop.

* Fix `CenterCrop` transform

* Fix `size` in five_crop.

* Fix `size` in ten_crop.

* Fix `kernel_size` and `sigma` in gaussian_blur.

* Fix `angle` and `shear` in affine.

* Fixing JIT-scriptability issues.

* Update TODOs.

* Restore fake types for `Union[int, List[int]]` and `Union[int, float, List[float]]`

* Fixing tests

* Fix linter

* revert unnecessary JIT mitigations.

* Cherrypick Philip's 6dfc9657ce89fe9e018a11ee25a8e26c7d3d43c6

* Linter fix

* Adding center float casting
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Align and Clean up transform types

* Move type definitions to `_utils.py`

* fixing error message on tests

* Apply code review suggestions
Co-authored-by: vfdev <vfdev.5@gmail.com>

* Centralizing types and switching to always getting dicts.

* Fixing linter

* Refactoring typing definitions.

* Remove relative imports.

* Reuse type.

* Temporarily remove the TorchData tests.

* Restore the TorchData tests.
Co-authored-by: vfdev <vfdev.5@gmail.com>

* [proto] Fixed fill type in AA

* Fixed missed typehints

* Set fill as None by default

* Another fix
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Moving `_parse_pad_padding()` to functional geometry

* Other updates to make previous commit consistent
Co-authored-by: Vasilis Vryniotis <vvryniotis@fb.com>

* add aliases for hflip and vflip

* reduce imports from torchvision.transforms in torchvision.prototype.transforms

* add aliases for to_pil_image abd pil_to_tensor

* deprecate to_tensor

* add some FIXME cleanup comments

* address reviews

* add dimension getters

* undeprecate PILToTensor and ToPILImage

* address review

* fix test

* move simple_tensor to features module

* fix test

* check full sample in query_bounding_box

* support no bounding boxes in FixedSizeCrop

* fix test

[proto] Consistent supported/unsupported types handling in LinearTransformation, other perf comments (#6498)

* WIP

* [proto] unformal supported/unsupported types handling in LinearTransformation, other perf comments

* Type fixes and other minor stuff

* Fixes unexpected behaviour with Transform._transformed_types and torch.Tensor

* Make code consistent to has_any, has_all implementation

* Fixed failing flake8 check

* add deprecated color conversion functionals

* allow grayscale tensor inputs in rgb_to_grayscale

* add cloning to tensor no-op

* improve todo comment

* [skip ci]

* use legacy kernels

use legacy kernels

* fix import

* remove duplicate code

* remove duplicate check

* add dispatcher for erase image kernels

* simplify RandomErasing

* replace query_image with query_image_dimensions

* use value sentinel and fix test for RandomErasing

* image_dimensions -> chw

* expand has_any and has_all to also accept check callables

* add test and fix has_all

* add support for simple tensor images to CutMix, MixUp and RandomIoUCrop

* remove TODO

* remove pythonic syntax sugar

* simplify

* use concreate examples in test rather than abstract ones

* simplify further

* [proto] Ported RandomIoUCrop from detection refs

* Scope acceptable data types

* Added get_params test

* Added test__transform_empty_params

* Added support for OneHotLabel and tests

* Added tests for mask

* Updated error message

* Apply suggestions from code review
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Added support for OHE masks and tests

* Ignored mypy error

* Fixed forward call on sample

* Added a todo
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* [proto] Added few transforms tests, part 1 (#6262)

* Added supported/unsupported data checks in the tests for cutmix/mixup

* Added RandomRotation, RandomAffine transforms tests

* Added tests for RandomZoomOut, Pad

* Update test_prototype_transforms.py

* Added RandomCrop transform and tests (#6271)

* [proto] Added GaussianBlur transform and tests (#6273)

* Added GaussianBlur transform and tests

* Fixing code format

* Copied correctness test

* [proto] Added random color transforms and tests (#6275)

* Added random color transforms and tests

* Disable smoke test for RandomSolarize, RandomAdjustSharpness

* Added RandomPerspective and tests (#6284)

- replaced real image creation by mocks for other tests

* Added more functional tests (#6285)

* [proto] Added elastic transform and tests (#6295)

* WIP [proto] Added functional elastic transform with tests

* Added more functional tests

* WIP on elastic op

* Added elastic transform and tests

* Added tests

* Added tests for ElasticTransform

* Try to format code as in https://github.com/pytorch/vision/pull/5106



* Fixed bug in affine get_params test

* Implemented RandomErase on PIL input as fallback to tensors (#6309)

Added tests

* Added image_size computation for BoundingBox.rotate if expand (#6319)

* Added image_size computation for BoundingBox.rotate if expand

* Added tests

* Added erase_image_pil and eager/jit erase_image_tensor test (#6320)

* Updates according to the review
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* upgrade usort to

* Also update black

* Actually use 1.0.2

* Apply pre-commit
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

* fix vanilla tensor image detection

* fix naming
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* fix grayscale to RGB for batches

* make unsupported types in auto augment a parameter

* make auto augment kwargs explicit

* add missing error message

* add support for specifying probabilites on RandomChoice

* remove TODO for deprecating p on random transforms

* streamline sample type checking

* address comments

* split image_size into height and width in auto augment
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* add prototype AugMix transform

* cleanup

* refactor auto augment subclasses to only trnasform a single image

* address review comments