GitLab

* update

* update

* docs: update README

* update docs

* style: make linter happy

* tmp

* update

* update

* finished the offloading impl

* the offloading is buggy

* update utils

* the offloading is still buggy

* update

* correctness and speedup done; need to check the vram overhead

* done

* final debugging

* update

* update

* correct now

* fix

* update

* use per-layer offloading

* fix the offloading on 5090

* support setting the num_blocks_on_gpu

* change the import name

* update

* update

* update README

* update dos

* update docs

* improve the lightning script

* update the example script

* change the repo name