Fixed KeyError for Mistral (#26682)

* Fixed KeyError for Mistral * Removed try block * Removed whitespace

Fixed KeyError for Mistral (#26682)
* Fixed KeyError for Mistral * Removed try block * Removed whitespace
8e05ad32 · Matteo Raso · GitHub · 762af3e3 · 8e05ad32
Unverified Commit 8e05ad32 authored Oct 13, 2023 by Matteo Raso Committed by GitHub Oct 13, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

src/transformers/models/mistral/convert_mistral_weights_to_hf.py ...nsformers/models/mistral/convert_mistral_weights_to_hf.py +1 -1

No files found.
--- a/src/transformers/models/mistral/convert_mistral_weights_to_hf.py
+++ b/src/transformers/models/mistral/convert_mistral_weights_to_hf.py
@@ -89,7 +89,7 @@ def write_model(model_path, input_base_path, model_size, tokenizer_path=None, sa
    num_shards = NUM_SHARDS[model_size]
    # For some reason this is a string in the params.json
-    sliding_window = int(params["ragged_attention"])
+    sliding_window = int(params["sliding_window"])
    n_layers = params["n_layers"]
    n_heads = params["n_heads"]
    n_heads_per_shard = n_heads // num_shards