Skip to content

GitLab

Unverified Commit ca7912d1 authored by Soyoung Yoon's avatar Soyoung Yoon Committed by GitHub
Browse files

Fix encoder->decoder typo bug in convert_t5x_checkpoint_to_pytorch.py (#26587) 

Fix bug in convert_t5x_checkpoint_to_pytorch.py
parent 8b03615b
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/models/t5/convert_t5x_checkpoint_to_pytorch.py
View file @ ca7912d1
...@@ -139,7 +139,7 @@ def convert_t5x_to_pytorch(variables: dict, *, num_layers: int, is_encoder_only: ...@@ -139,7 +139,7 @@ def convert_t5x_to_pytorch(variables: dict, *, num_layers: int, is_encoder_only:
new[f"decoder.block.{i}.layer.2.DenseReluDense.wi_0.weight"] = wi[0].T new[f"decoder.block.{i}.layer.2.DenseReluDense.wi_0.weight"] = wi[0].T
new[f"decoder.block.{i}.layer.2.DenseReluDense.wi_1.weight"] = wi[1].T new[f"decoder.block.{i}.layer.2.DenseReluDense.wi_1.weight"] = wi[1].T
else: else:
new[f"encoder.block.{i}.layer.2.DenseReluDense.wi.weight"] = wi.T new[f"decoder.block.{i}.layer.2.DenseReluDense.wi.weight"] = wi.T
new[f"decoder.block.{i}.layer.2.DenseReluDense.wo.weight"] = wo.T new[f"decoder.block.{i}.layer.2.DenseReluDense.wo.weight"] = wo.T
new["decoder.final_layer_norm.weight"] = old["decoder/decoder_norm/scale"] new["decoder.final_layer_norm.weight"] = old["decoder/decoder_norm/scale"]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment