lightx2v/common/ops/attn/ulysses_attn.py · b19d2ca280b26780ffa93b4eb57c4a89dcd9f7bc · xuwx1 / LightX2V

optimize ulysses-4090: balanced a2a and merged qkv (#590) · b19d2ca2

STwangyingrui authored Dec 10, 2025


Co-authored-by: root <root@pt-de4c35727a1b4d1b9f27f422f06026ec-worker-0.pt-de4c35727a1b4d1b9f27f422f06026ec.ns-devsft-3460edd0.svc.cluster.local>
Co-authored-by: root <root@pt-9b2035a55fe647eeb007584b238e5077-worker-0.pt-9b2035a55fe647eeb007584b238e5077.ns-devsft-3460edd0.svc.cluster.local>

b19d2ca2

ulysses_attn.py 21 KB

Replace ulysses_attn.py