• fatih's avatar
    [New Model] Add TimeSformer model (#18908) · cc3d0e1b
    fatih authored
    * init timesformer
    
    * apply fix-copies
    
    * reformat style
    
    * revert back some incoorect style updates
    
    * init timesformer
    
    * apply fix-copies
    
    * reformat style
    
    * revert back some incoorect style updates
    
    * update timseformer doc
    
    * add some functions and classes
    
    * add new config params
    
    * implement multiple classes
    
    * update TimeSformerLayer
    
    * update TimeSformerModel, TimeSformerPreTrainedModel, TimeSformerEncoder
    
    * several fixes
    
    * reformat
    
    * temporary update
    
    * fix some typos
    
    * fix weight converter
    
    * more fixes
    
    * fix a typo
    
    * fix typo
    
    * remove redundant params
    
    * fix for latest hf-hub
    
    * merge fix
    
    * fix some checks
    
    * video classification works with einops
    
    * add paper info to docs
    
    * merge fix
    
    * remove redundant line
    
    * remove redundant docstring
    
    * update config
    
    * fix some typos
    
    * fix converter
    
    * update some test constants
    
    * refactor einops functions
    
    * reformat
    
    * fix a comment
    
    * remove redundat imports
    
    * reformat
    
    * fix a typo
    
    * remove comment
    
    * remove unused imports
    
    * remove redundant doc line
    
    * reformat
    
    * add missing line
    
    * fix docs
    
    * fix timesformer auto feat ext
    
    * add unittests
    
    * reformat
    
    * fix docs
    
    * some fixes and updates
    
    * fix readme
    
    * fix modeling
    
    * fix readme
    
    * update index
    
    * revert _toctree.yml changes
    
    * update timseformer.mdx
    
    * update drop_path_prob to drop_path_rate
    
    * add dosctring for drop_path_rate
    
    * update TimeSformerPatchEmbed naming
    
    * remove to_2tuple
    
    * explicit use of nn.functional
    
    * reformat
    
    * many updates from review comments
    
    * fix a typo
    
    * reformat
    
    * remove assert, better variable name
    
    * make variable names more explicit
    
    * add some adapted from
    
    * more explicit variable names
    
    * remove redundant docstring
    
    * fix initilaization
    
    * move permute inside embedding
    
    * update class names
    
    * remove unused imports
    
    * add test for video classification
    
    * update PretrainedModel with PreTrainedModel
    
    * remove double permute
    
    * update based on sylvain's review
    
    * aply auto fix
    
    * update image_processing_auto for timesformer
    
    * update hub urls
    
    * reformat
    
    * remove duplicate import
    
    * update doc link
    cc3d0e1b
README.md 71.7 KB