GitLab

Update demo

Fixed the accuracy fluctuation bug

* add step & cfg distillation wan model

* add step & cfg distillation wan model

* bug fixed

* fix a image cat bug in parallel vae

Support gradio demo for wan i2v.

Update cache config and fix bugs.

* Implement distributed inference API server with FastAPI

- Added a new file `api_server_dist.py` to handle video generation tasks using distributed inference.
- Introduced endpoints for task submission, status checking, and result retrieval.
- Implemented image downloading and task management with error handling.
- Enhanced `infer.py` to ensure proper initialization of distributed processes.
- Created a shell script `start_api_with_dist_inference.sh` for easy server startup with environment setup.

This commit establishes a robust framework for managing video generation tasks in a distributed manner.

* Enhance file download endpoint with path traversal protection and error handling

* style: format

* refactor: Enhance video generation functionality with task interruption support

* feat: Add image upload and video generation endpoint with unique task handling

- Introduced a new endpoint `/v1/local/video/generate_form` for video generation that accepts image uploads.
- Implemented unique filename generation for uploaded images to prevent conflicts.
- Enhanced directory management for input and output paths.
- Improved file download response with detailed status and size information.
- Added error handling for distributed inference processes and graceful shutdown procedures.

Fix

fix.

* reconstruct quantization and fix memory leak bug.

* Support lazy load inference.

* reconstruct quantization

* Fix hunyuan bugs

* deleted tmp file

---------
Co-authored-by: root <root@pt-c0b333b3a1834e81a0d4d5f412c6ffa1-worker-0.pt-c0b333b3a1834e81a0d4d5f412c6ffa1.ns-devsft-3460edd0.svc.cluster.local>
Co-authored-by: gushiqiao <gushqiaio@sensetime.com>
Co-authored-by: gushiqiao <gushiqiao@sensetime.com>

* split dit server from default runner

* split dit server from default runner

* update loading functions

* simplify loader functions and runner functions

* simplify code && split dit service

* simplify code && split dit service

* support split server for cogvideox

* clear code.

* fix offload extra latency in the first step by pre-allocating pinned memory

* pre-commit

---------
Co-authored-by: “de1star” <“843414674@qq.com”>

* Update README.md

For deepwiki  auto refresh

* Update README.md
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

---------
Co-authored-by: Yang Yong(雍洋) <yongyang1030@163.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

* support prompt enhancer server

* bugs fixed

* finished prompt enhancer service

Co-authored-by: “de1star” <“843414674@qq.com”>

* add load_transformer methods for split server

* add service utils

* [feature] support split servers

* async offload & context4debug

* offload ratio

* Merge branch 'main' into xinchi/fix_offload

* adding offload ratio

* pre-commit

---------
Co-authored-by: “de1star” <“843414674@qq.com”>

Fix

Dev fixbugs