GitLab

Enable 720p model inference on low-spec GPUs/CPUs and accelerate T5/C…

Enable 720p model inference on low-spec GPUs/CPUs and accelerate T5/CLIP quantized models with vLLM operators

update lora adapter

Fix bugs

Co-authored-by: gushiqiao <gushiqiao@sensetime.com>

* Fix

* Fix

* Fix

---------
Co-authored-by: gushiqiao <gushiqiao@sensetime.com>

Co-authored-by: Linboyan-trc <1584340372@qq.com>

Co-authored-by: Linboyan-trc <1584340372@qq.com>

Fix.

Update demo

Fixed the accuracy fluctuation bug

* add step & cfg distillation wan model

* add step & cfg distillation wan model

* bug fixed

* fix a image cat bug in parallel vae

Support gradio demo for wan i2v.

Update cache config and fix bugs.

* Implement distributed inference API server with FastAPI

- Added a new file `api_server_dist.py` to handle video generation tasks using distributed inference.
- Introduced endpoints for task submission, status checking, and result retrieval.
- Implemented image downloading and task management with error handling.
- Enhanced `infer.py` to ensure proper initialization of distributed processes.
- Created a shell script `start_api_with_dist_inference.sh` for easy server startup with environment setup.

This commit establishes a robust framework for managing video generation tasks in a distributed manner.

* Enhance file download endpoint with path traversal protection and error handling

* style: format

* refactor: Enhance video generation functionality with task interruption support

* feat: Add image upload and video generation endpoint with unique task handling

- Introduced a new endpoint `/v1/local/video/generate_form` for video generation that accepts image uploads.
- Implemented unique filename generation for uploaded images to prevent conflicts.
- Enhanced directory management for input and output paths.
- Improved file download response with detailed status and size information.
- Added error handling for distributed inference processes and graceful shutdown procedures.

Fix