Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
9a68d3a8
Commit
9a68d3a8
authored
Nov 12, 2024
by
zhuwenwen
Browse files
update idefics2_vision_model.py
parent
c012f7f6
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
11 additions
and
1 deletion
+11
-1
vllm/model_executor/models/idefics2_vision_model.py
vllm/model_executor/models/idefics2_vision_model.py
+11
-1
No files found.
vllm/model_executor/models/idefics2_vision_model.py
View file @
9a68d3a8
...
@@ -23,7 +23,17 @@ import torch
...
@@ -23,7 +23,17 @@ import torch
from
torch
import
nn
from
torch
import
nn
from
transformers.models.idefics2.configuration_idefics2
import
(
from
transformers.models.idefics2.configuration_idefics2
import
(
Idefics2Config
,
Idefics2VisionConfig
)
Idefics2Config
,
Idefics2VisionConfig
)
from
xformers
import
ops
as
xops
# from xformers import ops as xops
import
vllm.envs
as
envs
try
:
if
envs
.
VLLM_ATTENTION_BACKEND
==
"XFormers"
:
from
xformers
import
ops
as
xops
else
:
print
(
"INFO: VLLM_ATTENTION_BACKEND is not XFormers.
\n
"
)
except
ImportError
:
print
(
"INFO: Please install xformers if you want to infer pixtral.
\n
"
)
from
vllm.distributed
import
divide
,
get_tensor_model_parallel_world_size
from
vllm.distributed
import
divide
,
get_tensor_model_parallel_world_size
from
vllm.model_executor.layers.activation
import
get_act_fn
from
vllm.model_executor.layers.activation
import
get_act_fn
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment