• Amanpreet Singh's avatar
    [feat] Add FLAVA model (#16654) · a10f6183
    Amanpreet Singh authored
    * [WIP] Add FLAVA model
    
    This PR aims to add [FLAVA](ihttps://arxiv.org/abs/2112.04482) model to the transformers repo.
    
    Following checklist delineates the list of things to be done for this PR
    to be complete:
    
    [x] Flava init
    [x] Flava base models
    [x] Flava layers
    [x] Flava Configs
    [x] Flava encoders
    [x] Flava pretraining models
    [ ] Flava classification/retrieval models (To be added in a separate PR)
    [x] Documentation updates 
    [x] Imports updates 
    [x] Argstring updates
    [x] Flava pretrained checkpoints 
    [x] Flava tests
    [x] Flava processors 
    [x] Sanity check
    [x] Lint
    a10f6183
processing_auto.py 12.3 KB