Unverified Commit 480fb357 authored by Leo Jiang's avatar Leo Jiang Committed by GitHub
Browse files

[Bugfix] typo fix in NPU FA (#12129)



[Bugfix] typo error in npu FA
Co-authored-by: default avatarJ石页 <jiangshuo9@h-partners.com>
Co-authored-by: default avatarAryan <aryan@huggingface.co>
parent 38740ddb
......@@ -944,7 +944,7 @@ def _native_npu_attention(
pse=None,
scale=1.0 / math.sqrt(query.shape[-1]) if scale is None else scale,
pre_tockens=65536,
next_tokens=65536,
next_tockens=65536,
keep_prob=1.0 - dropout_p,
sync=False,
inner_precise=0,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment