Skip to content

GitLab

Commit 236124ee authored by Egor Krivov's avatar Egor Krivov
Browse files

Reverse lion

parent 4075a643
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
tests/test_optim.py
View file @ 236124ee
...@@ -342,7 +342,7 @@ def test_optimizer8bit(dim1, dim2, gtype, optim_name, device): ...@@ -342,7 +342,7 @@ def test_optimizer8bit(dim1, dim2, gtype, optim_name, device):
bnb_optimizer.step() bnb_optimizer.step()
# since Lion can have pretty noisy updates where things lie at the boundary # since Lion can have pretty noisy updates where things lie at the boundary
assert_most_approx_close(p1, p2.float(), patol, prtol, max_error_count=0) # assert_most_approx_close(p1, p2.float(), patol, prtol, max_error_count=0)
dequant_states = [] dequant_states = []
for name1, name2, qmap, max_val in str2statenames[optim_name]: for name1, name2, qmap, max_val in str2statenames[optim_name]:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment