• mingruimingrui's avatar
    Bugfix: Removal of padding_idx in BartLearnedPositionalEmbedding (#10200) · 894db670
    mingruimingrui authored
    
    
    * Assumption of padding_idx <2 might not stand
    
    * Use offset instead of 2
    
    * Fix with black
    
    * Change behavior to warning instead for backward compatibility.
    
    * Fix with black
    
    * Remove warning
    
    * Make padding_idx non-required
    
    * padding_idx fix for blenderbot
    
    * padding_idx fix for blenderbot_small
    
    * padding_idx fix for led
    
    * padding_idx fix for mbart
    
    * Remove extra whitespaces
    
    * padding_idx fix for template
    
    * Fix padding_idx passed to nn.Embedding mistake
    
    * Fixed padding_idx passed to positional embedding in template
    
    * Remove padding_idx from pytorch learned positional embeddings
    
    * Remove accidentally added quotes
    
    * Remove padding_idx from tf learned positional embeddings
    
    * Remove zeroing of weights in __init__
    Co-authored-by: default avatarWang Ming Rui <mingrui.wang@C02CJTUYMD6M.local>
    894db670
modeling_led.py 130 KB