"git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "f72fe1f31aca235c7f675680832cc364efe4088e"
Unverified Commit d064fb56 authored by felixgwu's avatar felixgwu Committed by GitHub
Browse files

Fix the bug in constructing the all_hidden_states of DeBERTa v2 (#10466)

* fix all_hidden_states

* use output_states instead of next_kv
parent 188574ac
...@@ -450,10 +450,11 @@ class DebertaV2Encoder(nn.Module): ...@@ -450,10 +450,11 @@ class DebertaV2Encoder(nn.Module):
else: else:
next_kv = hidden_states next_kv = hidden_states
rel_embeddings = self.get_rel_embedding() rel_embeddings = self.get_rel_embedding()
output_states = next_kv
for i, layer_module in enumerate(self.layer): for i, layer_module in enumerate(self.layer):
if output_hidden_states: if output_hidden_states:
all_hidden_states = all_hidden_states + (hidden_states,) all_hidden_states = all_hidden_states + (output_states,)
output_states = layer_module( output_states = layer_module(
next_kv, next_kv,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment