"builder/git@developer.sourcefind.cn:OpenDAS/lmdeploy.git" did not exist on "8c672a7b3ad20e7b249675bf56793b4af842d7e5"
Commit 2ce4d9f8 authored by tink2123's avatar tink2123
Browse files

fix attn score

parent 5aa14c5f
...@@ -75,7 +75,7 @@ class AttentionHead(nn.Layer): ...@@ -75,7 +75,7 @@ class AttentionHead(nn.Layer):
probs_step, axis=1)], axis=1) probs_step, axis=1)], axis=1)
next_input = probs_step.argmax(axis=1) next_input = probs_step.argmax(axis=1)
targets = next_input targets = next_input
probs = paddle.nn.functional.softmax(probs, axis=2)
return probs return probs
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment