Skip to content

GitLab

"git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "7f74433814c916079dfaeb2de4163bc044b46717"
Unverified Commit 68b0baee authored by Alex Hedges's avatar Alex Hedges Committed by GitHub
Browse files

Ignore past_key_values during GPT-Neo inference (#13521)

parent 07c2607d
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
src/transformers/models/gpt_neo/configuration_gpt_neo.py
View file @ 68b0baee
......@@ -96,6 +96,7 @@ class GPTNeoConfig(PretrainedConfig):
>>> configuration = model.config
"""
model_type = "gpt_neo"
keys_to_ignore_at_inference = ["past_key_values"]
attribute_map = {"num_attention_heads": "num_heads", "num_hidden_layers": "num_layers"}
def __init__(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment