"...git@developer.sourcefind.cn:chenpangpang/open-webui.git" did not exist on "f4a18852983b8737368c35c9cfd3e3762b48c782"
Unverified Commit eacea530 authored by Cola's avatar Cola Committed by GitHub
Browse files

🚨 Remove warning of deprecation (#4477)

Remove warning of deprecated overload of addcdiv_

Fix #4451
parent fa2fbed3
......@@ -162,7 +162,7 @@ class AdamW(Optimizer):
bias_correction2 = 1.0 - beta2 ** state["step"]
step_size = step_size * math.sqrt(bias_correction2) / bias_correction1
p.data.addcdiv_(-step_size, exp_avg, denom)
p.data.addcdiv_(exp_avg, denom, value=-step_size)
# Just adding the square of the weights to the loss function is *not*
# the correct way of using L2 regularization/weight decay with Adam,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment