• Jorge C. Gomes's avatar
    Fixes LoRAXFormersCrossAttnProcessor (#2207) · 58c416ab
    Jorge C. Gomes authored
    Related to #2124 
    The current implementation is throwing a shape mismatch error. Which makes sense, as this line is obviously missing, comparing to XFormersCrossAttnProcessor and LoRACrossAttnProcessor.
    
    I don't have formal tests, but I compared `LoRACrossAttnProcessor` and `LoRAXFormersCrossAttnProcessor` ad-hoc, and they produce the same results with this fix.
    58c416ab
cross_attention.py 22.5 KB