Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
1c768fe5
Unverified
Commit
1c768fe5
authored
Dec 08, 2024
by
Cyrus Leung
Committed by
GitHub
Dec 07, 2024
Browse files
[Doc] Explicitly state that InternVL 2.5 is supported (#10978)
Signed-off-by:
DarkLight1337
<
tlleungac@connect.ust.hk
>
parent
bf0e382e
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
4 additions
and
4 deletions
+4
-4
docs/source/models/supported_models.rst
docs/source/models/supported_models.rst
+2
-2
examples/offline_inference_vision_language.py
examples/offline_inference_vision_language.py
+1
-1
examples/offline_inference_vision_language_multi_image.py
examples/offline_inference_vision_language_multi_image.py
+1
-1
No files found.
docs/source/models/supported_models.rst
View file @
1c768fe5
...
...
@@ -547,9 +547,9 @@ Text Generation
- ✅︎
-
* - :code:`InternVLChatModel`
- InternVL
2
- InternVL
2.5, Mono-InternVL, InternVL 2.0
- T + I\ :sup:`E+`
- :code:`OpenGVLab/Mono-InternVL-2B`, :code:`OpenGVLab/InternVL2-4B`,
:code:`OpenGVLab/InternVL2-8B`,
etc.
-
:code:`OpenGVLab/InternVL2_5-4B`,
:code:`OpenGVLab/Mono-InternVL-2B`, :code:`OpenGVLab/InternVL2-4B`, etc.
-
- ✅︎
* - :code:`LlavaForConditionalGeneration`
...
...
examples/offline_inference_vision_language.py
View file @
1c768fe5
...
...
@@ -223,7 +223,7 @@ def run_internvl(question: str, modality: str):
# Stop tokens for InternVL
# models variants may have different stop tokens
# please refer to the model card for the correct "stop words":
# https://huggingface.co/OpenGVLab/InternVL2-2B
#service
# https://huggingface.co/OpenGVLab/InternVL2-2B
/blob/main/conversation.py
stop_tokens
=
[
"<|endoftext|>"
,
"<|im_start|>"
,
"<|im_end|>"
,
"<|end|>"
]
stop_token_ids
=
[
tokenizer
.
convert_tokens_to_ids
(
i
)
for
i
in
stop_tokens
]
return
llm
,
prompt
,
stop_token_ids
...
...
examples/offline_inference_vision_language_multi_image.py
View file @
1c768fe5
...
...
@@ -165,7 +165,7 @@ def load_internvl(question: str, image_urls: List[str]) -> ModelRequestData:
# Stop tokens for InternVL
# models variants may have different stop tokens
# please refer to the model card for the correct "stop words":
# https://huggingface.co/OpenGVLab/InternVL2-2B
#service
# https://huggingface.co/OpenGVLab/InternVL2-2B
/blob/main/conversation.py
stop_tokens
=
[
"<|endoftext|>"
,
"<|im_start|>"
,
"<|im_end|>"
,
"<|end|>"
]
stop_token_ids
=
[
tokenizer
.
convert_tokens_to_ids
(
i
)
for
i
in
stop_tokens
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment