GitLab

* Revert "Revert "Register Torchvision Ops as Cutom Ops (#1267)" (#1316)"

This reverts commit fe234fc8.

* Make import of C++ extensions lazy

* define python initialization functions for extension

* Fix lint

* fix url

* update comment

This reverts commit 78f169b5.

* Register torchvision ops

* install ORT only with python 3

* remane lib + address other comments

* fix lint

* fix lib copy

* find file with pattern instead of suffix

* use relative path

* revert rename and use imp to find lib

* fix typo

* make shufflenet scriptable

* make resnet18 scriptable

* set downsample to identity instead of __constants__ api

* use __constants__ for downsample instead of identity

* import tensor to fix flake

* use torch.Tensor type annotation instead of import

* fixed typo

* fixed some more typos and grammer

* Fix flakiness of test_randomresized_params

* Real fix

* Reduce number of iters

* Use Tensor.data_ptr instead of .data

* use pytorch-nightly in CI

* Fix bug of changing input tensor in function

The original code will change the image tensor passed in by multiplying it by 255. The PR fixes that.

* fix inplace multiplication in save_image

Fixed video labelling after `subset` call for HMDB51 dataset (hmdb51.py) (EDIT: UCF101 as well) (#1240)

* Fixed video labelling after subset for HMDB51 dataset

* Fixed video labelling after subset for HMDB51 dataset
Co-authored-by: Eric Tang <etang21@stanford.edu>
Co-authored-by: Ryan Cao <ryancao@stanford.edu>

* UCF 101 Labeling fixes

- Analogous fix to HMDB51 to maintain correct labels after the train-test split
- Additional change to the `select_fold` method in `ucf101.py` to correctly reflect the annotation format
Co-authored-by: Ryan Cao <ryancao@stanford.edu>
Co-authored-by: Eric Tang <etang21@stanford.edu>

Following a similar line of inquiry to pytorch/audio#217

`self.fc1(x)` converts the shape of `x` into "N x 1024", and `self.fc2(x)` converts into "N x num_classes".

By adding `print(x.shape)` under each comment line, the console displays as follows (batch_size is 1):

```text
torch.Size([1, 2048])
torch.Size([1, 1024])
torch.Size([1, 1024])
torch.Size([1, 1024])
torch.Size([1, 1000])
```

* Add docs for video models

* Fix docstrings for resnet and vgg

* [WIP] Minor cleanups on R3d

* Move all models to video/resnet.py

* Remove old files

* Make tests less memory intensive

* Lint

* Fix typo and add pretraing arg to training script

* Expose docs for io and ops package

Had do modify the docstrings to use Napoleon NumPy style, because Napoleon Google Style doesn't support multiple return arguments

* Add video section

* Add docs to UCF101 and HMDB51 datasets

* Remove extra line

* Lint

* Move RandomClipSampler to references

* Lint and bugfix

Also add docs

* Copy classification scripts for video classification

* Initial version of video classification

* add version

* Training of r2plus1d_18 on kinetics work

Gives even slightly better results than expected, with 57.336 top1 clip accuracy. But we count some clips twice in this evaluation

* Cleanups on training script

* Lint

* Minor improvements

* Remove some hacks

* Lint

* Optimize read_video_timestamps for some formats

* Add some tests

* fix stl10

* fix lsun

* Miscellaneous fixes and improvements

* Guard against videos without video stream

* Fix lint

* Add test for packed b-frames videos

* Fix missing import

* [0.4_video] models - initial commit

* addressing fmassas inline comments

* pep8 and flake8

* simplify "hacks"

* sorting out latest comments

* nitpick

* Updated tests and constructors

* Added docstrings - ready to merge

* introduced function to verify str arguments

* flake8

* added FIXME to VOC

* Fixed error message

* added test for verify_str_arg

* cleanup todos

* added option for custom error message

* fix VOC

* fixed Caltech

* Add HMDB51 and UCF101

* Remove debug code

Also extend video saving to support different codecs and options. Notably, we can now save with lossless compression

* Properly order videos with B-frames

* seek doesn't seek to pts, but dts

Find a way of overcoming this problem.

Also make logging less verbose

* Replaced asserts with TORCH_CHECK

* Fixed an error

* in_channels_stage2 from backbone.inplanes

* remove type for backward compatible