Unverified Commit 96d673e0 authored by Cyrus Leung's avatar Cyrus Leung Committed by GitHub
Browse files

[Bugfix] Fix error handling of unsupported sliding window (#11213)


Signed-off-by: default avatarDarkLight1337 <tlleungac@connect.ust.hk>
parent b10609e6
...@@ -169,13 +169,15 @@ class LlamaAttention(nn.Module): ...@@ -169,13 +169,15 @@ class LlamaAttention(nn.Module):
) )
if hasattr(config, "interleaved_sliding_window"): if hasattr(config, "interleaved_sliding_window"):
if isinstance(config.interleaved_sliding_window, int): interleaved_sliding_window = config.interleaved_sliding_window
sliding_window = config.interleaved_sliding_window if isinstance(interleaved_sliding_window, int):
elif isinstance(config.interleaved_sliding_window, list): sliding_window = interleaved_sliding_window
sw_idx = layer_idx % len(config.interleaved_sliding_window) elif isinstance(interleaved_sliding_window, list):
sliding_window = config.interleaved_sliding_window[sw_idx] sw_idx = layer_idx % len(interleaved_sliding_window)
sliding_window = interleaved_sliding_window[sw_idx]
else: else:
raise ValueError(f"{type(sliding_window)} is not supported.") raise ValueError(
f"{type(interleaved_sliding_window)} is not supported.")
else: else:
sliding_window = None sliding_window = None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment