README.md 2.75 KB
Newer Older
Dongz's avatar
Dongz committed
1
# LightX2V: Light Video Generation Inference Framework
helloyongyang's avatar
helloyongyang committed
2

helloyongyang's avatar
helloyongyang committed
3
4
5
6
7
<div align="center">
  <picture>
    <img alt="LightLLM" src="assets/img_lightx2v.jpg" width=75%>
  </picture>
</div>
helloyongyang's avatar
helloyongyang committed
8

helloyongyang's avatar
helloyongyang committed
9
--------------------------------------------------------------------------------
helloyongyang's avatar
helloyongyang committed
10

helloyongyang's avatar
helloyongyang committed
11
12
13
14
15
16
17
18
19
20
## Supported Model List

[HunyuanVideo-T2V](https://huggingface.co/tencent/HunyuanVideo)

[HunyuanVideo-I2V](https://huggingface.co/tencent/HunyuanVideo-I2V)

[Wan2.1-T2V](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)

[Wan2.1-I2V](https://huggingface.co/Wan-AI/Wan2.1-I2V-14B-480P)

21
22
[Wan2.1-T2V-CausVid](https://huggingface.co/lightx2v/Wan2.1-T2V-14B-CausVid)

23
## Fast Start Up With Conda
helloyongyang's avatar
helloyongyang committed
24

Dongz's avatar
Dongz committed
25
```shell
26
# clone repo and submodules
27
git clone https://github.com/ModelTC/lightx2v.git lightx2v && cd lightx2v
28
git submodule update --init --recursive
29

30
# create conda env and install requirments
31
conda create -n lightx2v python=3.11 && conda activate lightx2v
helloyongyang's avatar
helloyongyang committed
32
33
34
35
pip install -r requirements.txt

# Install again separately to bypass the version conflict check
pip install transformers==4.45.2
36

37
# install flash-attention 2
helloyongyang's avatar
helloyongyang committed
38
cd lightx2v/3rd/flash-attention && pip install --no-cache-dir -v -e .
39
40

# install flash-attention 3, only if hopper
helloyongyang's avatar
helloyongyang committed
41
cd lightx2v/3rd/flash-attention/hopper && pip install --no-cache-dir -v -e .
42

43
44
# modify the parameters of the running script
bash scripts/run_hunyuan_t2v.sh
helloyongyang's avatar
helloyongyang committed
45
46
```

47
## Fast Start Up With Docker
helloyongyang's avatar
helloyongyang committed
48

Dongz's avatar
Dongz committed
49
```shell
zhiwei.dong's avatar
zhiwei.dong committed
50
docker pull lightx2v/lightx2v:latest
51
docker run -it --rm --name lightx2v --gpus all --ipc=host lightx2v/lightx2v:latest
helloyongyang's avatar
helloyongyang committed
52
```
Dongz's avatar
Dongz committed
53

54
## Contributing Guidelines
Dongz's avatar
Dongz committed
55

56
We have prepared a `pre-commit` hook to enforce consistent code formatting across the project. If your code complies with the standards, you should not see any errors, you can clean up your code following the steps below:
Dongz's avatar
Dongz committed
57
58
59
60

1. Install the required dependencies:

```shell
helloyongyang's avatar
helloyongyang committed
61
pip install ruff pre-commit
Dongz's avatar
Dongz committed
62
63
```

64
2. Then, run the following command before commit:
Dongz's avatar
Dongz committed
65
66

```shell
helloyongyang's avatar
helloyongyang committed
67
pre-commit run --all-files
Dongz's avatar
Dongz committed
68
69
```

70
71
72
73
74
75
3. Finally, please double-check your code to ensure it complies with the following additional specifications as much as possible:
  - Avoid hard-coding local paths: Make sure your submissions do not include hard-coded local paths, as these paths are specific to individual development environments and can cause compatibility issues. Use relative paths or configuration files instead.
  - Clear error handling: Implement clear error-handling mechanisms in your code so that error messages can accurately indicate the location of the problem, possible causes, and suggested solutions, facilitating quick debugging.
  - Detailed comments and documentation: Add comments to complex code sections and provide comprehensive documentation to explain the functionality of the code, input-output requirements, and potential error scenarios.

Thank you for your contributions!