Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
9572f74f
Unverified
Commit
9572f74f
authored
Jan 08, 2026
by
ShaanveerS
Committed by
GitHub
Jan 08, 2026
Browse files
[Model] Enable LoRA support for tower and connector in DotsOCR (#31825)
Signed-off-by:
ShaanveerS
<
shaanver.singh@gmail.com
>
parent
5f2a473f
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
9 additions
and
1 deletion
+9
-1
docs/models/supported_models.md
docs/models/supported_models.md
+1
-1
vllm/model_executor/models/dots_ocr.py
vllm/model_executor/models/dots_ocr.py
+8
-0
No files found.
docs/models/supported_models.md
View file @
9572f74f
...
...
@@ -371,7 +371,7 @@ th {
|
`DeepseekV2ForCausalLM`
| DeepSeek-V2 |
`deepseek-ai/DeepSeek-V2`
,
`deepseek-ai/DeepSeek-V2-Chat`
, etc. | ✅︎ | ✅︎ |
|
`DeepseekV3ForCausalLM`
| DeepSeek-V3 |
`deepseek-ai/DeepSeek-V3`
,
`deepseek-ai/DeepSeek-R1`
,
`deepseek-ai/DeepSeek-V3.1`
, etc. | ✅︎ | ✅︎ |
|
`Dots1ForCausalLM`
| dots.llm1 |
`rednote-hilab/dots.llm1.base`
,
`rednote-hilab/dots.llm1.inst`
, etc. | | ✅︎ |
|
`DotsOCRForCausalLM`
| dots_ocr |
`rednote-hilab/dots.ocr`
| | ✅︎ |
|
`DotsOCRForCausalLM`
| dots_ocr |
`rednote-hilab/dots.ocr`
|
✅︎
| ✅︎ |
|
`Ernie4_5ForCausalLM`
| Ernie4.5 |
`baidu/ERNIE-4.5-0.3B-PT`
, etc. | ✅︎ | ✅︎ |
|
`Ernie4_5_MoeForCausalLM`
| Ernie4.5MoE |
`baidu/ERNIE-4.5-21B-A3B-PT`
,
`baidu/ERNIE-4.5-300B-A47B-PT`
, etc. |✅︎| ✅︎ |
|
`ExaoneForCausalLM`
| EXAONE-3 |
`LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct`
, etc. | ✅︎ | ✅︎ |
...
...
vllm/model_executor/models/dots_ocr.py
View file @
9572f74f
...
...
@@ -765,6 +765,14 @@ class DotsOCRForCausalLM(nn.Module, SupportsMultiModal, SupportsPP, SupportsLoRA
def
get_language_model
(
self
)
->
torch
.
nn
.
Module
:
return
self
.
language_model
def
get_num_mm_encoder_tokens
(
self
,
num_image_tokens
:
int
)
->
int
:
merge_size
=
self
.
vision_tower
.
spatial_merge_size
return
num_image_tokens
*
(
merge_size
**
2
)
def
get_num_mm_connector_tokens
(
self
,
num_vision_tokens
:
int
)
->
int
:
merge_size
=
self
.
vision_tower
.
spatial_merge_size
return
num_vision_tokens
//
(
merge_size
**
2
)
def
embed_multimodal
(
self
,
**
kwargs
:
object
)
->
MultiModalEmbeddings
:
image_input
=
self
.
_parse_and_validate_image_input
(
**
kwargs
)
if
image_input
is
None
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment