• Poedator's avatar
    Llama: fix custom 4D masks, v2 (#30348) · a0779b9e
    Poedator authored
    
    
    * 4d mask fixes
    
    * Update custom 4D mask logic
    
    * test moved to mixin
    
    * extra tests 4d mask
    
    * upd 4d mask and StaticCache handling
    
    * added Mask4DTestHard to mistral tests
    
    * post-rebase fixes
    
    * test fixes for StaticCache
    
    * make fix-copies
    
    * upd 1 after #30476
    
    * fix common tests
    
    * rm elif attention_mask.dim() == 4:
    
    * tests combined, fixed, mixtral supported
    
    * bigbird style chg reverted
    
    * rm if attention_mask.dim() == 2
    
    * modeling_llama formatting chg
    
    ---------
    Co-authored-by: default avatarJoao Gante <joao@huggingface.co>
    a0779b9e
test_modeling_utils.py 93.5 KB