Merge pull request #76 from tomaarsen/cleanup

Cleanup involving a handful of failures, some optimization and a lot of code quality improvements

to_be_fixed__complaints_by_linter.log

-./setup.py:20:10: F541 f-string is missing placeholders
-./setup.py:21:13: F541 f-string is missing placeholders
-./quicktest.py:5:1: F401 'bitsandbytes as bnb' imported but unused
-./bitsandbytes/cuda_setup.py:42:56: F821 undefined name 'error_str'
-./bitsandbytes/cuda_setup.py:43:15: F541 f-string is missing placeholders
-./bitsandbytes/cuda_setup.py:67:5: F841 local variable 'context' is assigned to but never used
-./bitsandbytes/cuda_setup.py:68:5: F841 local variable 'error_str' is assigned to but never used
-./bitsandbytes/cuda_setup.py:76:9: F841 local variable 'result' is assigned to but never used
-./bitsandbytes/cuda_setup.py:144:13: F841 local variable 'has_gpu' is assigned to but never used
-./bitsandbytes/functional.py:294:13: F821 undefined name 'math'
-./bitsandbytes/functional.py:295:16: F821 undefined name 'math'
-./bitsandbytes/functional.py:303:5: F841 local variable 'ptrA' is assigned to but never used
-./bitsandbytes/functional.py:304:5: F841 local variable 'ptrOut' is assigned to but never used
-./bitsandbytes/functional.py:1057:17: W503 line break before binary operator
-./bitsandbytes/functional.py:1058:17: W503 line break before binary operator
-./bitsandbytes/functional.py:1059:17: W503 line break before binary operator
-./bitsandbytes/functional.py:1649:1: F811 redefinition of unused 'get_special_format_str' from line 160
-./bitsandbytes/functional.py:1687:5: F841 local variable 'ptrA' is assigned to but never used
-./bitsandbytes/functional.py:1688:5: F841 local variable 'ptrOut' is assigned to but never used
-./bitsandbytes/functional.py:1802:5: F841 local variable 'ccolsA' is assigned to but never used
-./bitsandbytes/functional.py:1805:5: F841 local variable 'cldb' is assigned to but never used
-./bitsandbytes/functional.py:1806:5: F841 local variable 'cldc' is assigned to but never used
-./bitsandbytes/functional.py:1873:9: F841 local variable 'dtype' is assigned to but never used
-./bitsandbytes/__init__.py:6:1: F401 '.autograd._functions.MatmulLtState' imported but unused
-./bitsandbytes/__init__.py:6:1: F401 '.autograd._functions.bmm_cublas' imported but unused
-./bitsandbytes/__init__.py:6:1: F401 '.autograd._functions.matmul' imported but unused
-./bitsandbytes/__init__.py:6:1: F401 '.autograd._functions.matmul_cublas' imported but unused
-./bitsandbytes/__init__.py:6:1: F401 '.autograd._functions.mm_cublas' imported but unused
-./bitsandbytes/__init__.py:9:1: F401 '.nn.modules' imported but unused
-./bitsandbytes/__init__.py:12:5: F401 '.optim.adam' imported but unused
-./bitsandbytes/autograd/_functions.py:5:1: F401 'bitsandbytes as bnb' imported but unused
-./bitsandbytes/autograd/_functions.py:12:75: W291 trailing whitespace
-./bitsandbytes/nn/__init__.py:5:1: F401 '.modules.Int8Params' imported but unused
-./bitsandbytes/nn/__init__.py:5:1: F401 '.modules.Linear8bit' imported but unused
-./bitsandbytes/nn/__init__.py:5:1: F401 '.modules.Linear8bitLt' imported but unused
-./bitsandbytes/nn/__init__.py:5:1: F401 '.modules.StableEmbedding' imported but unused
-./bitsandbytes/nn/modules.py:5:1: F401 'typing.Any' imported but unused
-./bitsandbytes/nn/modules.py:5:1: F401 'typing.Callable' imported but unused
-./bitsandbytes/nn/modules.py:5:1: F401 'typing.Dict' imported but unused
-./bitsandbytes/nn/modules.py:5:1: F401 'typing.Iterator' imported but unused
-./bitsandbytes/nn/modules.py:5:1: F401 'typing.Mapping' imported but unused
-./bitsandbytes/nn/modules.py:5:1: F401 'typing.Set' imported but unused
-./bitsandbytes/nn/modules.py:5:1: F401 'typing.Tuple' imported but unused
-./bitsandbytes/nn/modules.py:11:1: F401 'torch.nn.parameter.Parameter' imported but unused
-./bitsandbytes/nn/modules.py:183:13: W503 line break before binary operator
-./bitsandbytes/nn/modules.py:184:13: W503 line break before binary operator
-./bitsandbytes/nn/modules.py:272:24: F821 undefined name 'dist'
-./bitsandbytes/nn/modules.py:272:49: F821 undefined name 'dist'
-./bitsandbytes/optim/optimizer.py:243:9: F841 local variable 'overflows' is assigned to but never used
-./bitsandbytes/optim/optimizer.py:280:35: F541 f-string is missing placeholders
-./bitsandbytes/optim/optimizer.py:283:35: F541 f-string is missing placeholders
-./bitsandbytes/optim/lars.py:27:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/lars.py:59:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/lars.py:91:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/lars.py:157:13: F841 local variable 'params_with_grad' is assigned to but never used
-./bitsandbytes/optim/lars.py:158:13: F841 local variable 'd_p_list' is assigned to but never used
-./bitsandbytes/optim/lars.py:159:13: F841 local variable 'momentum_buffer_list' is assigned to but never used
-./bitsandbytes/optim/lars.py:174:35: F821 undefined name 'param'
-./bitsandbytes/optim/__init__.py:9:5: F401 '.adam.Adam' imported but unused
-./bitsandbytes/optim/__init__.py:9:5: F401 '.adam.Adam8bit' imported but unused
-./bitsandbytes/optim/__init__.py:9:5: F401 '.adam.Adam32bit' imported but unused
-./bitsandbytes/optim/__init__.py:10:5: F401 '.adamw.AdamW' imported but unused
-./bitsandbytes/optim/__init__.py:10:5: F401 '.adamw.AdamW8bit' imported but unused
-./bitsandbytes/optim/__init__.py:10:5: F401 '.adamw.AdamW32bit' imported but unused
-./bitsandbytes/optim/__init__.py:11:5: F401 '.sgd.SGD' imported but unused
-./bitsandbytes/optim/__init__.py:11:5: F401 '.sgd.SGD8bit' imported but unused
-./bitsandbytes/optim/__init__.py:11:5: F401 '.sgd.SGD32bit' imported but unused
-./bitsandbytes/optim/__init__.py:12:5: F401 '.lars.LARS' imported but unused
-./bitsandbytes/optim/__init__.py:12:5: F401 '.lars.LARS8bit' imported but unused
-./bitsandbytes/optim/__init__.py:12:5: F401 '.lars.LARS32bit' imported but unused
-./bitsandbytes/optim/__init__.py:12:5: F401 '.lars.PytorchLARS' imported but unused
-./bitsandbytes/optim/__init__.py:13:5: F401 '.lamb.LAMB' imported but unused
-./bitsandbytes/optim/__init__.py:13:5: F401 '.lamb.LAMB8bit' imported but unused
-./bitsandbytes/optim/__init__.py:13:5: F401 '.lamb.LAMB32bit' imported but unused
-./bitsandbytes/optim/__init__.py:14:5: F401 '.rmsprop.RMSprop' imported but unused
-./bitsandbytes/optim/__init__.py:14:5: F401 '.rmsprop.RMSprop8bit' imported but unused
-./bitsandbytes/optim/__init__.py:14:5: F401 '.rmsprop.RMSprop32bit' imported but unused
-./bitsandbytes/optim/__init__.py:15:5: F401 '.adagrad.Adagrad' imported but unused
-./bitsandbytes/optim/__init__.py:15:5: F401 '.adagrad.Adagrad8bit' imported but unused
-./bitsandbytes/optim/__init__.py:15:5: F401 '.adagrad.Adagrad32bit' imported but unused
-./bitsandbytes/optim/__init__.py:17:1: F401 '.optimizer.GlobalOptimManager' imported but unused
-./bitsandbytes/optim/adam.py:229:21: F841 local variable 'max_exp_avg_sq' is assigned to but never used
-./bitsandbytes/optim/rmsprop.py:25:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/rmsprop.py:27:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/rmsprop.py:59:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/rmsprop.py:61:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/rmsprop.py:94:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/rmsprop.py:96:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/sgd.py:24:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/sgd.py:55:39: F541 f-string is missing placeholders
-./bitsandbytes/optim/sgd.py:86:39: F541 f-string is missing placeholders
-./tests/test_optim.py:1:1: F401 'ctypes' imported but unused
-./tests/test_optim.py:199:5: F841 local variable 'mask' is assigned to but never used
-./tests/test_optim.py:218:9: F841 local variable 'atol' is assigned to but never used
-./tests/test_optim.py:218:15: F841 local variable 'rtol' is assigned to but never used
-./tests/test_optim.py:304:17: W503 line break before binary operator
-./tests/test_optim.py:354:21: W503 line break before binary operator
-./tests/test_autograd.py:309:13: F841 local variable 'err' is assigned to but never used
-./tests/test_cuda_setup_evaluator.py:31:9: F821 undefined name 'test_dir'
-./tests/test_cuda_setup_evaluator.py:33:14: F821 undefined name 'test_input'
-./tests/test_cuda_setup_evaluator.py:81:32: E203 whitespace before ':'
-./tests/test_functional.py:55:13: F841 local variable 'ms' is assigned to but never used
-./tests/test_functional.py:177:5: F841 local variable 'diffs' is assigned to but never used
-./tests/test_functional.py:178:5: F841 local variable 'reldiffs' is assigned to but never used
-./tests/test_functional.py:260:5: F841 local variable 'minA' is assigned to but never used
-./tests/test_functional.py:261:5: F841 local variable 'maxA' is assigned to but never used
-./tests/test_functional.py:584:5: F841 local variable 'func' is assigned to but never used
-./tests/test_functional.py:617:17: F841 local variable 'offset' is assigned to but never used
-./tests/test_functional.py:618:17: F841 local variable 'col2' is assigned to but never used
-./tests/test_functional.py:619:17: F841 local variable 'row2' is assigned to but never used
-./tests/test_functional.py:705:9: F841 local variable 'C1' is assigned to but never used
-./tests/test_functional.py:706:9: F841 local variable 'C2' is assigned to but never used
-./tests/test_functional.py:715:9: F841 local variable 'output' is assigned to but never used
-./tests/test_functional.py:750:5: F841 local variable 'formatB' is assigned to but never used
-./tests/test_functional.py:754:5: F841 local variable 'w2' is assigned to but never used
-./tests/test_functional.py:763:5: F841 local variable 'dtype' is assigned to but never used
-./tests/test_functional.py:770:9: F841 local variable 'out1' is assigned to but never used
-./tests/test_functional.py:1108:5: F841 local variable 'relerr1' is assigned to but never used
-./tests/test_functional.py:1108:14: F841 local variable 'relerr2' is assigned to but never used
-./tests/test_functional.py:1114:9: F841 local variable 'C1' is assigned to but never used
-./tests/test_functional.py:1135:9: F841 local variable 'C4' is assigned to but never used
-./tests/test_functional.py:1179:5: F841 local variable 'err1' is assigned to but never used
-./tests/test_functional.py:1179:11: F841 local variable 'err2' is assigned to but never used
-./tests/test_functional.py:1179:17: F841 local variable 'err3' is assigned to but never used
-./tests/test_functional.py:1180:5: F841 local variable 'relerr1' is assigned to but never used
-./tests/test_functional.py:1180:14: F841 local variable 'relerr2' is assigned to but never used
-./tests/test_functional.py:1192:9: F841 local variable 'C1' is assigned to but never used
-./tests/test_functional.py:1313:9: F841 local variable 'c' is assigned to but never used
-./tests/test_functional.py:1314:9: F841 local variable 'c2' is assigned to but never used
-./tests/test_functional.py:1406:9: F841 local variable 'C1' is assigned to but never used
-./tests/test_functional.py:1425:9: F841 local variable 'out2' is assigned to but never used
-./tests/test_functional.py:1542:5: F841 local variable 'idx_col' is assigned to but never used
-./tests/test_functional.py:1566:30: E203 whitespace before ':'
-./tests/test_functional.py:1568:38: E203 whitespace before ':'
-./tests/test_functional.py:1655:5: F841 local variable 'offset' is assigned to but never used
-./tests/test_functional.py:1706:9: F841 local variable 'out' is assigned to but never used
-./tests/test_functional.py:1822:9: F841 local variable 'out' is assigned to but never used
-./tests/test_functional.py:1882:5: F841 local variable 'out2' is assigned to but never used
-./tests/test_functional.py:1928:9: F841 local variable 'dtype' is assigned to but never used
-./tests/test_functional.py:1934:9: F841 local variable 'minx' is assigned to but never used
-./tests/test_functional.py:1948:5: F841 local variable 'C0' is assigned to but never used
-./tests/test_modules.py:1:1: F401 'itertools.product' imported but unused
-./tests/test_modules.py:52:9: F841 local variable 'norm' is assigned to but never used
-./tests/test_modules.py:52:16: F821 undefined name 'math'
-./tests/test_modules.py:52:26: F821 undefined name 'math'
-./tests/test_modules.py:52:37: F821 undefined name 'math'
-./tests/test_modules.py:177:21: F821 undefined name 'einops'
-./tests/test_modules.py:233:9: F841 local variable 'stochastic' is assigned to but never used
-./tests/test_modules.py:382:9: F841 local variable 'o1' is assigned to but never used