• Ratthachat (Jung)'s avatar
    Add TFDPR (#8203) · 026a2ff2
    Ratthachat (Jung) authored
    * Create modeling_tf_dpr.py
    
    * Add TFDPR
    
    * Add back TFPegasus, TFMarian, TFMBart, TFBlenderBot
    
    last commit accidentally deleted these 4 lines, so I recover them back
    
    * Add TFDPR
    
    * Add TFDPR
    
    * clean up some comments, add TF input-style doc string
    
    * Add TFDPR
    
    * Make return_dict=False as default
    
    * Fix return_dict bug (in .from_pretrained)
    
    * Add get_input_embeddings()
    
    * Create test_modeling_tf_dpr.py
    
    The current version is already passed all 27 tests!
    Please see the test run at : 
    https://colab.research.google.com/drive/1czS_m9zy5k-iSJbzA_DP1k1xAAC_sdkf?usp=sharing
    
    
    
    * fix quality
    
    * delete init weights
    
    * run fix copies
    
    * fix repo consis
    
    * del config_class, load_tf_weights
    
    They shoud be 'pytorch only'
    
    * add config_class back
    
    after removing it, test failed ... so totally only removing "use_tf_weights = None" on Lysandre suggestion
    
    * newline after .. note::
    
    * import tf, np (Necessary for ModelIntegrationTest)
    
    * slow_test from_pretrained with from_pt=True
    
    At the moment we don't have TF weights (since we don't have official official TF model)
    Previously, I did not run slow test, so I missed this bug
    
    * Add simple TFDPRModelIntegrationTest
    
    Note that this is just a test that TF and Pytorch gives approx. the same output.
    However, I could not test with the official DPR repo's output yet
    
    * upload correct tf model
    
    * remove position_ids as missing keys
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    Co-authored-by: default avatarpatrickvonplaten <patrick@huggingface.co>
    026a2ff2
dpr.rst 4.42 KB