Skip to content

GitLab

"...composable_kernel.git" did not exist on "5b02dfafb182f39bea1161268aaf8c5e14eaedfa"
Unverified Commit 543889f3 authored by Arthur's avatar Arthur Committed by GitHub
Browse files

[`GptNeox`] don't gather on pkv when using the trainer (#29892) 

don't gather on pkv when using the trainer
parent b256516a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
src/transformers/models/gpt_neox/configuration_gpt_neox.py
View file @ 543889f3
...@@ -103,6 +103,7 @@ class GPTNeoXConfig(PretrainedConfig): ...@@ -103,6 +103,7 @@ class GPTNeoXConfig(PretrainedConfig):
```""" ```"""
model_type = "gpt_neox" model_type = "gpt_neox"
keys_to_ignore_at_inference = ["past_key_values"]
def __init__( def __init__(
self, self,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment