GitLab

* feat: expose norm1 layer to support TeaCache

* feat: add TeaCache example

* feat: add idx as optional parameter

* chore: rename function

* refactor: move TeaCache decorator into example script

* test: add a test for the combination of Nunchaku with TeaCache

* feat: expose norm1 layer to support TeaCache

* feat: add TeaCache example

* feat: add idx as optional parameter

* chore: rename function

* refactor: move TeaCache decorator into example script

* test: add a test for the combination of Nunchaku with TeaCache

* fix: make tests run on low memory hardware

* fix: ensure that memory is correctly released between tests

* fix: avoid moving pipeline to device prematurely

* gpu memory does not release

* need to figure out a way to get compatible with offloading

* wrap up the teacache

---------
Co-authored-by: muyangli <lmxyy1999@foxmail.com>

* fix: fix a typo

* style: format the imports

* fix forward_layer in FluxModel.cpp

* Update FluxModel.cpp

WHO THE HELL INVENTED ADL?

This should fix mit-han-lab/nunchaku#162

Co-authored-by: Zhekai Zhang <sxtyzhangzk@gmail.com>
Co-authored-by: Muyang Li <lmxyy1999@foxmail.com>
Co-authored-by: Yujun Lin <16437040+synxlin@users.noreply.github.com>

Used to resolve Windows 10 crash issues.

Finalizing deepcompressor migration

Removing torch dependencies in gemm kernel
Merged tinychat_pybind and pybind
Merged the load and setup script