GitLab

Summary: provider callback uses video sampler to copy/scale input frames using sws_scale function, added option to use av_image_copy to copy image planes in case if sws_getContext fails (required to support AV_PIX_FMT_PAL8 pixel format)

Reviewed By: ovoietsa

Differential Revision: D36466749

fbshipit-source-id: 1674f98a362db835d147800c24bdda6f82d2f8ff
Co-authored-by: Sergiy Bilobrov <sergiy@fb.com>

Summary:
Resolves https://www.internalfb.com/tasks/?t=128004042

Caused by TorchVision's PR at https://github.com/pytorch/vision/pull/6322 which was in response to a change on PyTorch Core at https://github.com/pytorch/pytorch/pull/82032

Reviewed By: fmassa

Differential Revision: D38383266

fbshipit-source-id: 3f0ebd04a610031c4720123d1869a851f76455cd

* Broken down PR(#6269). Added an additional dataset

* Removed some types. Store None instead of "". Merged test util functions.

* minor mypy fixes. minor doc fixes

* reformated docstring

* Added additional line-skips

* Fix bug in calculating cIoU for unequal sizes

* Remove comment

* what the epsilon?

* Fixing DIoU

* Optimization by Francisco.

* Fix the expected values on CompleteBoxIoU

* Apply suggestions from code review
Co-authored-by: Abhijit Deo <72816663+abhi-glitchhg@users.noreply.github.com>

* Adding cartesian product test.

* remove static
Co-authored-by: Vasilis Vryniotis <vvryniotis@fb.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>
Co-authored-by: Abhijit Deo <72816663+abhi-glitchhg@users.noreply.github.com>

* cleaning up box decoding

* minor nits

* cleanup for box encoding also addded.

* Model registration mechanism.

* Add overwrite options to the dataset prototype registration mechanism.

* Adding example models.

* Fix module filtering

* Fix linter

* Fix docs

* Make name optional if same as model builder

* Apply updates from code-review.

* fix minor bug

* Adding getter for model weight enum

* Support both strings and callables on get_model_weight.

* linter fixes

* Fixing mypy.

* Renaming `get_model_weight` to `get_model_weights`

* Registering all classification models.

* Registering all video models.

* Registering all detection models.

* Registering all optical flow models.

* Fixing mypy.

* Registering all segmentation models.

* Registering all quantization models.

* Fixing linter

* Registering all prototype depth perception models.

* Adding tests and updating existing tests.

* Fix linters

* Fix tests.

* Add beta annotation on docs.

* Fix tests.

* Apply changes from code-review.

* Adding documentation.

* Fix docs.

[FBcode->GH]
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/81946



Reviewed By: linbinyu

Differential Revision: D38056789

fbshipit-source-id: 6a2e2d3308c9eec5b2230e153c5e2863b3b5bf7b
Co-authored-by: Sim Sun <simsun@fb.com>

* [proto] Added few transforms tests, part 1 (#6262)

* Added supported/unsupported data checks in the tests for cutmix/mixup

* Added RandomRotation, RandomAffine transforms tests

* Added tests for RandomZoomOut, Pad

* Update test_prototype_transforms.py

* Added RandomCrop transform and tests (#6271)

* [proto] Added GaussianBlur transform and tests (#6273)

* Added GaussianBlur transform and tests

* Fixing code format

* Copied correctness test

* [proto] Added random color transforms and tests (#6275)

* Added random color transforms and tests

* Disable smoke test for RandomSolarize, RandomAdjustSharpness

* Added RandomPerspective and tests (#6284)

- replaced real image creation by mocks for other tests

* Added more functional tests (#6285)

* [proto] Added elastic transform and tests (#6295)

* WIP [proto] Added functional elastic transform with tests

* Added more functional tests

* WIP on elastic op

* Added elastic transform and tests

* Added tests

* Added tests for ElasticTransform

* Try to format code as in https://github.com/pytorch/vision/pull/5106



* Fixed bug in affine get_params test

* Implemented RandomErase on PIL input as fallback to tensors (#6309)

Added tests

* Added image_size computation for BoundingBox.rotate if expand (#6319)

* Added image_size computation for BoundingBox.rotate if expand

* Added tests

* Added erase_image_pil and eager/jit erase_image_tensor test (#6320)

* Updates according to the review
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Refactor tests

* Remove tol, fix comments

* Add tolerance only where necessary

* Add tolerance only where necessary

* Add tolerance only where necessary

* Refactor to adapt suggestions

* Refactor and add nits

* Refactor box area

* Refactor to one file

* Adapt almost all except area

* final update

* Tighten for jit

* Refactor slightly

* Fix tests
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Indicate strings can be used to specify

* quotes

Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* [proto] Added missing decorator for center_crop_segmentation_mask tests

* Added center_crop_image_tensor

Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* intial structure

* fixed types of few variables

* remove the commented code

* list -> List

* encode method will take input as tensors instead of list of tensor
Co-authored-by: Joao Gomes <jdsgomes@fb.com>

* Update git-blame-ignore-revs following new ufmt version

* Un-do ufmt version changed, got mixed up

* upgrade usort to

* Also update black

* Actually use 1.0.2

* Apply pre-commit
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>

Co-authored-by: Alexander Jipa <azzhipa@amazon.com>

* fix inplace mutation

* Different attn shouldn't share the same attribute

* a simpler solution
Co-authored-by: YosuaMichael <yosuamichaelm@gmail.com>

* Moved pfm file reading into dataset utils

* Made _read_pfm private. Fixed doc format issues.

* Another attempt to add transforms

* Fixed padding type hint

* Fixed fill arg for pad and rotate, affine

* code formatting and type hints for affine transformation

* Fixed flake8

* Updated tests to save and load transforms

* Fixed code formatting issue

* Fixed jit loading issue

* Restored fill default value to None
Updated code according to the review

* Added tests for rotation, affine and zoom transforms

* Put back commented code

* Random erase bypass boxes and masks
Go back with if-return/elif-return/else-return

* Fixed acceptable and non-acceptable types for Cutmix/Mixup

* Updated conditions for _BaseMixupCutmix

* Make ConvNormActivation function accept tuple for kernel_size, stride, padding, and dilation

* Fix the method to get the conv_dim

* Simplify if-elif logic

* Updated tests to save and load transforms

* Fixed code formatting issue

* Add ensembled video accuracy on video reference script

* Change the parser func to be similar with classification reference

* Fix typo type->dtype

* Use custom kinetics

* Fix dataset to not getting start_pts

* Change dataset name, and put video_idx at the back

* Ufmt format

* Use functional softmax, updating meta and use it to overwrite eval param

* Fix typo

* Put the eval parameters on the docs for now

* Change meta for video resnet to use frame-rate 15, also change wording on docs

* Added mid-level ops and feature-based ops

* Fixing deadlock in dataloader with circular imports

* Added non-scalar fill support workaround for pad

* Removed comments

* int/float support for fill in pad op

* Updated type hints and removed bypass option from mid-level methods

* Minor nit fixes

* basic structure

* added constrains

* fixed errors

* thanks to vadim!

* addressing the comments and added docstrign

* Apply suggestions from code review
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Make `_log_api_usage_once` work for overwritten classes

* Change module prefix to `torchvision.internal`

* Refactor setup.py to build only wanted extensions.

* Improve visual feedback for libpng support in setup.py.

* Improve printing of extensions finding in setup.py.

* Fix linter errors.

* Apply suggestions from code review
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* Update the dataset cache to factor in parameters from the args.

* Fix linter

To make project https://peps.python.org/pep-0517/ compliant

Solves https://github.com/pytorch/pytorch/issues/80745