Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
bitsandbytes
Commits
697bd02c
"...text-generation-inference.git" did not exist on "08b3eac2ce54e25bec12088fd7e69ee3c07adaf5"
Commit
697bd02c
authored
Oct 27, 2022
by
Tom Aarsen
Browse files
Resolve dangerous default value [] as argument
parent
b5cf7063
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
2 deletions
+3
-2
bitsandbytes/autograd/_functions.py
bitsandbytes/autograd/_functions.py
+3
-2
No files found.
bitsandbytes/autograd/_functions.py
View file @
697bd02c
...
...
@@ -50,8 +50,9 @@ class GlobalOutlierPooler:
class
MatMul8bit
(
torch
.
autograd
.
Function
):
@
staticmethod
def
forward
(
ctx
,
A
,
B
,
out
=
None
,
quant_type
=
"vector"
,
precision
=
[
8
,
8
,
8
]):
def
forward
(
ctx
,
A
,
B
,
out
=
None
,
quant_type
=
"vector"
,
precision
=
None
):
if
precision
is
None
:
precision
=
[
8
,
8
,
8
]
if
precision
[
0
]
!=
8
:
with
torch
.
no_grad
():
output
=
torch
.
matmul
(
A
,
B
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment