• Li-Huai (Allan) Lin's avatar
    Fix and improve REALM fine-tuning (#15297) · 7b3bd1f2
    Li-Huai (Allan) Lin authored
    * Draft
    
    * Add test
    
    * Update src/transformers/models/realm/modeling_realm.py
    
    * Apply suggestion
    
    * Add block_mask
    
    * Update
    
    * Update
    
    * Add block_embedding_to
    
    * Remove no_grad
    
    * Use AutoTokenizer
    
    * Remove model.to overridding
    7b3bd1f2
realm.mdx 3.16 KB