Skip to content

GitLab

Unverified Commit c712d05a authored by Raushan Turganbay's avatar Raushan Turganbay Committed by GitHub
Browse files

Pass `use_cache` in kwargs for GPTNeoX (#30538) 

pass use_cache in kwargs
parent a3aabc70
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
src/transformers/models/gpt_neox/modeling_gpt_neox.py
View file @ c712d05a
...@@ -1108,6 +1108,7 @@ class GPTNeoXForCausalLM(GPTNeoXPreTrainedModel): ...@@ -1108,6 +1108,7 @@ class GPTNeoXForCausalLM(GPTNeoXPreTrainedModel):
"attention_mask": attention_mask, "attention_mask": attention_mask,
"past_key_values": past_key_values, "past_key_values": past_key_values,
"position_ids": position_ids, "position_ids": position_ids,
"use_cache": kwargs.get("use_cache"),
} }
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment