Skip to content

GitLab

Unverified Commit be7f3d5d authored by Xinyu Dong's avatar Xinyu Dong Committed by GitHub
Browse files

[Bugfix] fix default is_neox_style is True for deepseek (#34353) 


Signed-off-by: default avatardongxinyu03 <dongxinyu03@baidu.com>
parent 0ab06100
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/models/deepseek_v2.py
View file @ be7f3d5d
...@@ -836,7 +836,7 @@ class DeepseekV2MLAAttention(nn.Module): ...@@ -836,7 +836,7 @@ class DeepseekV2MLAAttention(nn.Module):
qk_rope_head_dim, qk_rope_head_dim,
max_position=max_position_embeddings, max_position=max_position_embeddings,
rope_parameters=config.rope_parameters, rope_parameters=config.rope_parameters,
is_neox_style=not getattr(config, "indexer_rope_interleave", True), is_neox_style=not getattr(config, "indexer_rope_interleave", False),
) )
self.indexer = Indexer( self.indexer = Indexer(
vllm_config, vllm_config,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment