GitLab

Set pytorch vision decoder probesize for getting stream info based on the value from decode setting (#6900) (#6950)

Summary:
Pull Request resolved: https://github.com/pytorch/vision/pull/6900



1. Pass along the value of probesize from decode setting.
2. allow pytorch vision decoder to set the probesize for getting stream info

Reviewed By: jdsgomes

Differential Revision: D40967782

fbshipit-source-id: 642ae3b67c50b1fdafc20f9814a52fdf5db527d7
Co-authored-by: Chen Liu <cliu7@meta.com>

* Adding FLOPs and size to model metadata

* Adding weight size to quantization models

* Small refactor of rich metadata

* Removing unused code

* Fixing wrong entries

* Adding .DS_Store to gitignore

* Renaming _flops to _ops

* Adding number of operations to quantization models

* Reflecting _flops change to _ops

* Renamed ops and weight size in individual model doc pages

* Linter fixes

* Rounding ops to first decimal

* Rounding num ops and sizes to 3 decimals

* Change naming of columns.

* Update tables
Co-authored-by: Toni Blaslov <tblaslov@fb.com>
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* remove prototype datasets from CI

* move encoded features to prototype datasets namespace

* remove decoding transforms

* [REVERT ME] reinstate prototype datasets CI

* Revert "[REVERT ME] reinstate prototype datasets CI"

This reverts commit 215fb185cf6be5be7adf0388116c77acc9a5d3f3.

* Performance optimization on adjust_hue_image_tensor

* handle ints

* Inplace logical ops

* Remove unnecessary casting.

* Fix linter.

* Port elastic and minor cleanups

* Update torchvision/prototype/transforms/functional/_geometry.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Performance optimization for autocontrast

* Fixing tests

* Avoid double casting on adjust_contrast

* Handle properly ints.

* Speed up `adjust_sharpness_image_tensor`

* Add a comment

* add a signature consistency tests for v1 vs. v2 dispatchers

* temporarily increase test verbosity

* Revert "temporarily increase test verbosity"

This reverts commit 468c73f727af8dde8a2a3cc3063fd64923c50f63.

* fix test to allow annotation deviations

* fill <-> center for rotate

* ignore annotation changes for center / translate in rotate / affine

* [proto] small optim for perspective op on images, reverted concat trick on bboxes

* revert unrelated changes

* PR review updates

* PR review change

This reverts commit 2e833520.

* Restore BC on perspective

* Fixes linter

* Fixing tests.

* Apply code-review changes.

* Pleasing mypy.

* Revert named parameters.

* [proto] Small optims for elastic op on bboxes

* More inplace ops according to the review

* Create grid on device directly. This should be faster

* PR Review update. Apply ceil on float input

* replace tensor division with scalar division and tensor multiplication

* fix consistency test tolerances

* fix prototype kernels

* fix stable kernels

* fix tests

* make test more robust

* improve invert for signed integers

* improve invert

* fix posterize

* Revert "assume that integer images are [0, 255] in equalize (#6859)"

This reverts commit 436ff9a5

.

* fix solarize in AA

* fix resize

* Revert "fix resize"

This reverts commit 5f33f4aa73e098237650b794157ec9335d964152.

* add comment to float max value
Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>

* remove unnecessary changes from pad_image_tensor

* cleanup

* fix fill=None workaround

* address review comments

* remove more xfails

* Bbox resize optimization

* Other (untested) optimizations on `_affine_bounding_box_xyxy` and `elastic_bounding_box`.

* fix conflict

* Reverting changes on elastic

* revert one more change

* Further improvement

* [proto] Speed-up crop on bboxes and tests

* Fix linter

* Update _geometry.py

* Fixed device issue

* Revert changes in test/prototype_transforms_kernel_infos.py

* Fixed failing correctness tests

* [proto] Optimized functional pad op for bboxes + tests

* Renamed copy-pasted variable name

* [proto] Small optims for perspective bboxes op

* [proto] Speed-up crop on bboxes and tests

* Fix linter

* Update _geometry.py

* Fixed device issue

* Revert changes in test/prototype_transforms_kernel_infos.py

* Fixed failing correctness tests

* [proto] Optimized functional pad op for bboxes + tests

* Renamed copy-pasted variable name

* Code update

* Fixes according to the review

* Ported `resize`

* Align with previous behaviour

* Update torchvision/prototype/transforms/functional/_geometry.py
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Moving input verification on top of method.
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* [proto] Speed-up crop on bboxes and tests

* Fix linter

* Update _geometry.py

* Fixed device issue

* Revert changes in test/prototype_transforms_kernel_infos.py

* Fixed failing correctness tests

* Refactor gaussian_blur

* Add conditional reshape

* Further refactoring

* Remove unused import.

* make weights deepcopyable

* add test

* test enum member instead of whole enum

* Reducing unnecessary method calls

* Optimize pad branch.

* Remove unnecessary call to crop_image_tensor

* Fix linter
Co-authored-by: vfdev <vfdev.5@gmail.com>

* [proto][tests] Added ref functions for h/v flips

* Better dtype handling in reference_affine_bounding_box_helper

* [proto] Speed-up h/v bboxes flip ops

* Use more inplace ops

* Removed _old methods

* Fixed jit issue using a bit slower version

* Adjust solarize threshold on input type

* Handle PIL images

* minor refactor

* Fix linter

* Test: add backend parameter

* VideoReader object now works on backend

* Frame reading now passes

* Keyframe seek now passes

* Pyav backend now supports metadata

* changes in test to reflect GPU decoder change

* Linter?

* Test GPU output

* Addressing Joao's comments

* lint

* lint

* Revert "Test GPU output"

This reverts commit f62e955d7dc81bcb23b40d58ea75413b9b62e76d.

* lint?

* lint

* lint

* Address issues in build?

* hopefully doc fix

* Arrgh

* arrgh

* fix typos

* fix input options

* remove read from memory option in pyav

* skip read from mem test for gpu and pyab be

* fix test

* remove unused import

* Hack to get reading from memory work with pyav

* patch audio test
Co-authored-by: Bruno Korbar <bkorbar@quansight.com>
Co-authored-by: Joao Gomes <jdsgomes@fb.com>

* Add support of inplace on `convert_format_bounding_box`

* Move `as_subclass` calls to `F` invocations

* Fix bug.

* Fix _cxcywh_to_xyxy.

* Fixing _xyxy_to_cxcywh.

* Adding comments.

* extend support of posterize to all integer and floating dtypes

* remove raise

* revert to fixed value range for integer dtypes

* extend equalize to all integer and floating dtypes

* address nits

Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* style: Fixed typing of dataset __getitem__

* style: Fixed last missing typing
Co-authored-by: Philip Meier <github.pmeier@posteo.de>

* Change random generator for ColorJitter.

* Move `_convert_fill_arg` from runtime to constructor.

* Remove unnecessary TypeVars.

* Remove unnecessary casts

* Update comments.

* Minor code-quality changes on Geometical Transforms.

* Fixing linter and other minor fixes.

* Change mitigation for mypy.`

* Fixing the tests.

* Fixing the tests.

* Fix linter

* Restore dict copy.

* Handling of defaultdicts

* restore int idiom

* Update todo