Unverified Commit 4e571ce6 authored by Matthew Bonanni's avatar Matthew Bonanni Committed by GitHub
Browse files

[MTP][Misc] Clean up dead code (#36507)


Signed-off-by: default avatarMatthew Bonanni <mbonanni@redhat.com>
parent 4ff9b045
......@@ -481,10 +481,7 @@ class SpecDecodeBaseProposer:
positions = self.mrope_positions[:, token_indices_to_sample]
else:
positions = self.positions[token_indices_to_sample]
if self.method == "mtp":
hidden_states = self.hidden_states[token_indices_to_sample]
else:
hidden_states = hidden_states[token_indices_to_sample]
hidden_states = hidden_states[token_indices_to_sample]
if isinstance(attn_metadata, TreeAttentionMetadata):
# Draft using tree attention - requires full logits for top-k
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment