GitLab

* Init deploy: not ok

* Test data_manager & task_manager

* pipeline is no need for worker

* Update worker text_encoder

* deploy: submit task

* add apis

* Test pipelineRunner

* Fix pipeline

* Tidy worker & test PipelineWorker ok

* Tidy code

* Fix multi_stage for wan2.1 t2v & i2v

* api query task, get result & report subtasks failed when workers stop

* Add model list functionality to Pipeline and API

* Add task cancel and task resume  to API

* Add RabbitMQ queue manager

* update local task manager atomic

* support postgreSQL task manager, add lifespan async init

* worker print -> logger

* Add S3 data manager, delete temp objects after finished.

* fix worker

* release fetch queue msg when closed, run stuck worker in another thread, stop worker when process down.

* DiTWorker run with thread & tidy logger print

* Init monitor without test

* fix monitor

* github OAuth and jwt token access & static demo html page

* Add user to task, ok for local task manager & update demo ui

* sql task manager support users

* task list with pages

* merge main fix

* Add proxy for auth request

* support wan audio

* worker ping subtask and ping life, fix rabbitmq async get,

* s3 data manager with async api & tidy monitor config

* fix merge main & update req.txt & fix html view video error

* Fix distributed worker

* LImit user visit freq

* Tidy

* Fix only rank save

* Fix audio input

* Fix worker fetch None

* index.html abs path to rel path

* Fix dist worker stuck

* support publish output video to rtmp & graceful stop running dit step or segment step

* Add VAReader

* Enhance VAReader with torch dist

* Fix audio stream input

* fix merge refractor main, support stream input_audio and output_video

* fix audio read with prev frames & fix end take frames & tidy worker end

* split audio model to 4 workers & fix audio end frame

* fix ping subtask with queue

* Fix audio worker put block & add whep, whip without test ok

* Tidy va recorder & va reader log, thread canel within 30s

* Fix dist worker stuck: broadcast stop signal

* Tidy

* record task active_elapse & subtask status_elapse

* Design prometheus metrics

* Tidy prometheus metrics

* Fix merge main

* send sigint to ffmpeg process

* Fix gstreamer pull audio by whep & Dockerfile for gstreamer & check params when submitting

* Fix merge main

* Query task with more info & va_reader buffer size = 1

* Fix va_recorder

* Add config for prev_frames

* update frontend

* update frontend

* update frontend

* update frontend
merge

* update frontend & partial backend

* Different rank for va_recorder and va_reader

* Fix mem leak: only one rank publish video, other rank should pop gen vids

* fix task category

* va_reader pre-alloc tensor & va_recorder send frames all & fix dist cancel infer

* Fix prev_frame_length

* Tidy

* Tidy

* update frontend & backend

* Fix lint error

* recover some files

* Tidy

* lint code

---------
Co-authored-by: liuliang1 <liuliang1@sensetime.com>
Co-authored-by: unknown <qinxinyi@sensetime.com>

* [Feat] Support vae bf16 and add 4090 best config

* [Feat] Support vae bf16 and add 4090 best config

* [Feat] Support vae bf16 and add 4090 best config

* [Feat] Support vae bf16 and add 4090 best config

* update dtype

---------
Co-authored-by: helloyongyang <yongyang1030@163.com>

* [Fix] Fix audio model offload bug.

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* has read BaseRunner -> DefaultRunner -> WanRunner's init

* FirstBlock

* FirstBlock

* FirstBlock

* FirstBlock

* FirstBlock

* FirstBlock

* FirstBlock

* DualBlock

* DynamicBlock

* DynamicBlock

* DynamicBlock

* DynamicBlock

* DynamicBlock

* DualBlock Downsample Factor

* DualBlock Downsample Factor

* Downsample

* Downsample

refactor: update WanTransformerInfer and VideoGenerator to improve audio handling and progress tracking

refactor: update DefaultRunner to return audio as None and modify WanAudioRunner to handle audio saving and frame interpolation

* feat: add vfi(rife)

* refactor: update video saving functionality and add VAE to ComfyUI image conversion.

* refactor: enhance video saving process and integrate VAE to ComfyUI image conversion

* refactor: reorganize imports and enhance code structure in default_runner and utils modules

* feat: add video frame interpolation support with RIFE model integration

* refactor: streamline code structure and improve readability in IFNet and refine modules

* fix: style

* feat: add script for downloading and installing RIFE model with flownet.pkl extraction

* update

* docs: update README and documentation to include video frame interpolation feature with RIFE model

* fix ci

* docs: enhance video frame interpolation documentation and update configuration usage for RIFE model

---------
Co-authored-by: helloyongyang <yongyang1030@163.com>

* Enhance BaseRunner with model protocols and type hints and fix lora load

* Add support for multiple LoRAs configuration and enhance lora_strength argument handling

* doc: style fix

* Add asynchronous processing capabilities with AsyncWrapper and BaseRunner class implementation

* Refactor async I/O functions for consistency and improved readability

* Add progress callback functionality to DefaultRunner and improve logging during execution

* Enhance DefaultRunner's run_pipeline method to include optional video saving functionality

* Remove unnecessary deletion of inputs in DefaultRunner's run_pipeline method to streamline resource management

* fix: correct frequency computation in WanTransformerInfer

* refactor: restructure API server and distributed inference services

- Removed the old api_server_dist.py file and integrated its functionality into a new modular structure.
- Created a new ApiServer class to handle API routes and services.
- Introduced DistributedInferenceService and FileService for better separation of concerns.
- Updated the main entry point to initialize and run the new API server with distributed inference capabilities.
- Added schema definitions for task requests and responses to improve data handling.
- Enhanced error handling and logging throughout the services.

* refactor: enhance API structure and file handling in server

- Introduced APIRouter for modular route management in the ApiServer class.
- Updated task creation and file download endpoints to improve clarity and functionality.
- Implemented a new method for streaming file responses with proper MIME type handling.
- Refactored task request schema to auto-generate task IDs and handle optional video save paths.
- Improved error handling and logging for better debugging and user feedback.

* feat: add configurable parameters for video generation

- Introduced new parameters: infer_steps, target_video_length, and seed to the API and task request schema.
- Updated DefaultRunner and VideoGenerationService to handle the new parameters for enhanced video generation control.
- Improved default values for parameters to ensure consistent behavior.

* refactor: enhance profiling context for async support

* refactor: improve signal handling in API server

* feat: enhance video generation capabilities with audio support

* refactor: improve subprocess call for audio-video merging in wan_audio_runner.py

* refactor: enhance API server argument parsing and improve code readability

* refactor: enhance logging and improve code comments for clarity

* refactor: update response model for task listing endpoint to return a dictionary

* docs: update API endpoints and improve documentation clarity

* refactor: update API endpoints in scripts for task management and remove unused code

* fix: pre-commit

* add step & cfg distillation wan model