GitLab

fix the guard to fall back to the baseline fused layer norm kernel

Persisten ln: move the guard for supported hidden sizes to layer norm module

Adds some backward compatibility code so old inference code still works.

consider the case of pipeline-model prallelism

clean up arugments

argument naming cleanup

update readme and examples