GitLab

allow for uploading to pypi

Since we could be parallelizing over seqlen_k

To avoid import error if one doesn't have rotary_emb installed

This is faster since we only need to do atomic adds on dq, instead of atomic
adds on both dk and dv.

WIP because there seems to be some race conditions for head dimensions other
than 16, 32, 64, 128.