"sgl-kernel/git@developer.sourcefind.cn:zhaoyu6/sglang.git" did not exist on "cb4fb0eef59a38dfad9ab90d2b0d64025b938f19"
  • Beinsezii's avatar
    EulerAncestral add `rescale_betas_zero_snr` (#6187) · 457abdf2
    Beinsezii authored
    
    
    * EulerAncestral add `rescale_betas_zero_snr`
    
    Uses same infinite sigma fix from EulerDiscrete. Interestingly the
    ancestral version had the opposite problem: too much contrast instead of
    too little.
    
    * UT for EulerAncestral `rescale_betas_zero_snr`
    
    * EulerAncestral upcast samples during step()
    
    It helps this scheduler too, particularly when the model is using bf16.
    
    While the noise dtype is still the model's it's automatically upcasted
    for the add so all it affects is determinism.
    
    ---------
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    457abdf2
scheduling_euler_ancestral_discrete.py 19.3 KB