Unverified Commit e3fbb6f1 authored by Dongjie Zou's avatar Dongjie Zou Committed by GitHub
Browse files

fix#30092 Kimi-Linear model loading failure with missing indexer_rotary_emb (#30093)


Signed-off-by: default avatarbaonudesifeizhai <baonudesifeizhai@gmail.com>
parent c4d62618
......@@ -24,9 +24,9 @@ class MLAModules:
q_b_proj: torch.nn.Module | None
q_proj: torch.nn.Module | None
indexer: torch.nn.Module | None
indexer_rotary_emb: torch.nn.Module | None
is_sparse: bool
topk_indices_buffer: torch.Tensor | None
indexer_rotary_emb: torch.nn.Module | None = None
@CustomOp.register("multi_head_latent_attention")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment