• Sangkug Lym's avatar
    persistent fused layer norm · a2fdcdf0
    Sangkug Lym authored
    fix the guard to fall back to the baseline fused layer norm kernel
    
    Persisten ln: move the guard for supported hidden sizes to layer norm module
    a2fdcdf0
transformer.py 29.1 KB