Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
bb48e921
Unverified
Commit
bb48e921
authored
May 20, 2024
by
Arthur
Committed by
GitHub
May 20, 2024
Browse files
`tokenizer_class = "AutoTokenizer"` Llava Family (#30912)
propagate changes to more models
parent
76e05301
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
3 deletions
+3
-3
src/transformers/models/llava_next/processing_llava_next.py
src/transformers/models/llava_next/processing_llava_next.py
+2
-2
src/transformers/models/video_llava/processing_video_llava.py
...transformers/models/video_llava/processing_video_llava.py
+1
-1
No files found.
src/transformers/models/llava_next/processing_llava_next.py
View file @
bb48e921
...
@@ -40,8 +40,8 @@ class LlavaNextProcessor(ProcessorMixin):
...
@@ -40,8 +40,8 @@ class LlavaNextProcessor(ProcessorMixin):
"""
"""
attributes
=
[
"image_processor"
,
"tokenizer"
]
attributes
=
[
"image_processor"
,
"tokenizer"
]
image_processor_class
=
"
LlavaNext
ImageProcessor"
image_processor_class
=
"
Auto
ImageProcessor"
tokenizer_class
=
(
"LlamaTokenizer"
,
"Llama
Tokenizer
Fast"
)
tokenizer_class
=
"Auto
Tokenizer
"
def
__init__
(
self
,
image_processor
=
None
,
tokenizer
=
None
):
def
__init__
(
self
,
image_processor
=
None
,
tokenizer
=
None
):
super
().
__init__
(
image_processor
,
tokenizer
)
super
().
__init__
(
image_processor
,
tokenizer
)
...
...
src/transformers/models/video_llava/processing_video_llava.py
View file @
bb48e921
...
@@ -42,7 +42,7 @@ class VideoLlavaProcessor(ProcessorMixin):
...
@@ -42,7 +42,7 @@ class VideoLlavaProcessor(ProcessorMixin):
attributes
=
[
"image_processor"
,
"tokenizer"
]
attributes
=
[
"image_processor"
,
"tokenizer"
]
image_processor_class
=
"VideoLlavaImageProcessor"
image_processor_class
=
"VideoLlavaImageProcessor"
tokenizer_class
=
(
"LlamaTokenizer"
,
"Llama
Tokenizer
Fast"
)
tokenizer_class
=
"Auto
Tokenizer
"
def
__init__
(
self
,
image_processor
=
None
,
tokenizer
=
None
):
def
__init__
(
self
,
image_processor
=
None
,
tokenizer
=
None
):
super
().
__init__
(
image_processor
,
tokenizer
)
super
().
__init__
(
image_processor
,
tokenizer
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment