Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Latte_pytorch
Commits
c0c47f6f
Commit
c0c47f6f
authored
Feb 27, 2024
by
mashun1
Browse files
latte
parent
e8655448
Pipeline
#800
failed with stages
in 0 seconds
Changes
3
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
16 additions
and
12 deletions
+16
-12
README.md
README.md
+15
-11
models/latte_t2v.py
models/latte_t2v.py
+1
-1
sample_videos/t2vYellow_and_black_tropical_fish_dart_through_the_sea._0000webv-imageio.mp4
..._tropical_fish_dart_through_the_sea._0000webv-imageio.mp4
+0
-0
No files found.
README.md
View file @
c0c47f6f
...
...
@@ -58,17 +58,21 @@
数据结构,这里为示例数据(仅展示UCF-101),完整数据请按如下结构准备。
UCF-101_tiny
├── ApplyEyeMakeup
│ └── v_ApplyEyeMakeup_g01_c01.avi
├── ApplyLipstick
│ └── v_ApplyLipstick_g01_c01.avi
├── Archery
│ └── v_Archery_g01_c01.avi
├── BabyCrawling
│ └── v_BabyCrawling_g01_c01.avi
├── BalanceBeam
├── .....
train_datasets/
└── UCF-101_tiny
├── ApplyEyeMakeup
│ └── v_ApplyEyeMakeup_g01_c01.avi
├── ApplyLipstick
│ └── v_ApplyLipstick_g01_c01.avi
├── Archery
│ └── v_Archery_g01_c01.avi
├── BabyCrawling
│ └── v_BabyCrawling_g01_c01.avi
├── BalanceBeam
│ └── v_BalanceBeam_g01_c01.avi
├── BandMarching
│ └── v_BandMarching_g01_c01.avi
## 训练
...
...
models/latte_t2v.py
View file @
c0c47f6f
...
...
@@ -541,7 +541,7 @@ class LatteT2V(ModelMixin, ConfigMixin):
f
"Has to define `in_channels`:
{
in_channels
}
, `num_vector_embeds`:
{
num_vector_embeds
}
, or patch_size:"
f
"
{
patch_size
}
. Make sure that `in_channels`, `num_vector_embeds` or `num_patches` is not None."
)
# 2. Define input layers
if
self
.
is_input_continuous
:
self
.
in_channels
=
in_channels
...
...
sample_videos/t2vYellow_and_black_tropical_fish_dart_through_the_sea._0000webv-imageio.mp4
View file @
c0c47f6f
No preview for this file type
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment