Commit 9be1ff2d authored by Xinyu Dong's avatar Xinyu Dong Committed by khluu
Browse files

[Bugfix] fix default is_neox_style is True for deepseek (#34353)


Signed-off-by: default avatardongxinyu03 <dongxinyu03@baidu.com>
(cherry picked from commit be7f3d5d)
parent b3ee90f9
......@@ -836,7 +836,7 @@ class DeepseekV2MLAAttention(nn.Module):
qk_rope_head_dim,
max_position=max_position_embeddings,
rope_parameters=config.rope_parameters,
is_neox_style=not getattr(config, "indexer_rope_interleave", True),
is_neox_style=not getattr(config, "indexer_rope_interleave", False),
)
self.indexer = Indexer(
vllm_config,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment