• Andrea Ferretti's avatar
    feat: expose norm1 layer to support TeaCache (#234) · b4d3f50b
    Andrea Ferretti authored
    
    
    * feat: expose norm1 layer to support TeaCache
    
    * feat: add TeaCache example
    
    * feat: add idx as optional parameter
    
    * chore: rename function
    
    * refactor: move TeaCache decorator into example script
    
    * test: add a test for the combination of Nunchaku with TeaCache
    
    * feat: expose norm1 layer to support TeaCache
    
    * feat: add TeaCache example
    
    * feat: add idx as optional parameter
    
    * chore: rename function
    
    * refactor: move TeaCache decorator into example script
    
    * test: add a test for the combination of Nunchaku with TeaCache
    
    * fix: make tests run on low memory hardware
    
    * fix: ensure that memory is correctly released between tests
    
    * fix: avoid moving pipeline to device prematurely
    
    * gpu memory does not release
    
    * need to figure out a way to get compatible with offloading
    
    * wrap up the teacache
    
    ---------
    Co-authored-by: default avatarmuyangli <lmxyy1999@foxmail.com>
    b4d3f50b
FluxModel.h 4.39 KB