GitLab

* use CM scheduler for distill_models as default

* update configs

* support dynamic cfg for cfg_distill

* reformat files

* add readme

* modify readme

* update lora keys

* update lora extractor/merger tools

* rename lora config and script files

* bug fixed for lora tools

Enable 720p model inference on low-spec GPUs/CPUs and accelerate T5/CLIP quantized models with vLLM operators

Co-authored-by: gushiqiao <gushiqiao@sensetime.com>

* add step & cfg distillation wan model

* bug fixed

* reconstruct quantization and fix memory leak bug.

* Support lazy load inference.

* reconstruct quantization

* Fix hunyuan bugs

* deleted tmp file

---------
Co-authored-by: root <root@pt-c0b333b3a1834e81a0d4d5f412c6ffa1-worker-0.pt-c0b333b3a1834e81a0d4d5f412c6ffa1.ns-devsft-3460edd0.svc.cluster.local>
Co-authored-by: gushiqiao <gushqiaio@sensetime.com>
Co-authored-by: gushiqiao <gushiqiao@sensetime.com>

* split dit server from default runner

* split dit server from default runner

* update loading functions

* simplify loader functions and runner functions

* simplify code && split dit service

* simplify code && split dit service

* support split server for cogvideox

* clear code.

* add load_transformer methods for split server

* add service utils

* [feature] support split servers