GitLab

* add gguf loading functions

* support wan22 distill

* feat: add vfi(rife)

* refactor: update video saving functionality and add VAE to ComfyUI image conversion.

* refactor: enhance video saving process and integrate VAE to ComfyUI image conversion

* refactor: reorganize imports and enhance code structure in default_runner and utils modules

* feat: add video frame interpolation support with RIFE model integration

* refactor: streamline code structure and improve readability in IFNet and refine modules

* fix: style

* feat: add script for downloading and installing RIFE model with flownet.pkl extraction

* update

* docs: update README and documentation to include video frame interpolation feature with RIFE model

* fix ci

* docs: enhance video frame interpolation documentation and update configuration usage for RIFE model

---------
Co-authored-by: helloyongyang <yongyang1030@163.com>

* Enhance BaseRunner with model protocols and type hints and fix lora load

* Add support for multiple LoRAs configuration and enhance lora_strength argument handling

* doc: style fix

* Add asynchronous processing capabilities with AsyncWrapper and BaseRunner class implementation

* Refactor async I/O functions for consistency and improved readability

* Add progress callback functionality to DefaultRunner and improve logging during execution

* Enhance DefaultRunner's run_pipeline method to include optional video saving functionality

* Remove unnecessary deletion of inputs in DefaultRunner's run_pipeline method to streamline resource management

* fix: correct frequency computation in WanTransformerInfer

* refactor: restructure API server and distributed inference services

- Removed the old api_server_dist.py file and integrated its functionality into a new modular structure.
- Created a new ApiServer class to handle API routes and services.
- Introduced DistributedInferenceService and FileService for better separation of concerns.
- Updated the main entry point to initialize and run the new API server with distributed inference capabilities.
- Added schema definitions for task requests and responses to improve data handling.
- Enhanced error handling and logging throughout the services.

* refactor: enhance API structure and file handling in server

- Introduced APIRouter for modular route management in the ApiServer class.
- Updated task creation and file download endpoints to improve clarity and functionality.
- Implemented a new method for streaming file responses with proper MIME type handling.
- Refactored task request schema to auto-generate task IDs and handle optional video save paths.
- Improved error handling and logging for better debugging and user feedback.

* feat: add configurable parameters for video generation

- Introduced new parameters: infer_steps, target_video_length, and seed to the API and task request schema.
- Updated DefaultRunner and VideoGenerationService to handle the new parameters for enhanced video generation control.
- Improved default values for parameters to ensure consistent behavior.

* refactor: enhance profiling context for async support

* refactor: improve signal handling in API server

* feat: enhance video generation capabilities with audio support

* refactor: improve subprocess call for audio-video merging in wan_audio_runner.py

* refactor: enhance API server argument parsing and improve code readability

* refactor: enhance logging and improve code comments for clarity

* refactor: update response model for task listing endpoint to return a dictionary

* docs: update API endpoints and improve documentation clarity

* refactor: update API endpoints in scripts for task management and remove unused code

* fix: pre-commit

* split dit server from default runner

* split dit server from default runner

* update loading functions

* simplify loader functions and runner functions

* simplify code && split dit service

* simplify code && split dit service

* support split server for cogvideox

* clear code.

* support prompt enhancer server

* bugs fixed

* finished prompt enhancer service

* add load_transformer methods for split server

* add service utils

* [feature] support split servers

* async offload & context4debug

* offload ratio

* Merge branch 'main' into xinchi/fix_offload

* adding offload ratio

* pre-commit

---------
Co-authored-by: “de1star” <“843414674@qq.com”>

* fix offload

* fix offload

---------
Co-authored-by: “de1star” <“843414674@qq.com”>