Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
bitsandbytes
Commits
277ac27b
"csrc/pythonInterface.cpp" did not exist on "cad839941b2c0a013525be339f6e9c157caa925d"
Unverified
Commit
277ac27b
authored
Jan 29, 2024
by
Aarni Koskela
Committed by
GitHub
Jan 29, 2024
Browse files
Correct type annotation for quantize_4bit (#994)
parent
8ddfda13
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
1 deletion
+10
-1
bitsandbytes/functional.py
bitsandbytes/functional.py
+10
-1
No files found.
bitsandbytes/functional.py
View file @
277ac27b
...
@@ -890,7 +890,16 @@ def quantize_fp4(A: Tensor, absmax: Tensor = None, out: Tensor = None, blocksize
...
@@ -890,7 +890,16 @@ def quantize_fp4(A: Tensor, absmax: Tensor = None, out: Tensor = None, blocksize
def
quantize_nf4
(
A
:
Tensor
,
absmax
:
Tensor
=
None
,
out
:
Tensor
=
None
,
blocksize
=
64
,
compress_statistics
=
False
,
quant_storage
=
torch
.
uint8
):
def
quantize_nf4
(
A
:
Tensor
,
absmax
:
Tensor
=
None
,
out
:
Tensor
=
None
,
blocksize
=
64
,
compress_statistics
=
False
,
quant_storage
=
torch
.
uint8
):
return
quantize_4bit
(
A
,
absmax
,
out
,
blocksize
,
compress_statistics
,
'nf4'
,
quant_storage
)
return
quantize_4bit
(
A
,
absmax
,
out
,
blocksize
,
compress_statistics
,
'nf4'
,
quant_storage
)
def
quantize_4bit
(
A
:
Tensor
,
absmax
:
Tensor
=
None
,
out
:
Tensor
=
None
,
blocksize
=
64
,
compress_statistics
=
False
,
quant_type
=
'fp4'
,
quant_storage
=
torch
.
uint8
)
->
(
Tensor
,
QuantState
):
def
quantize_4bit
(
A
:
Tensor
,
absmax
:
Tensor
=
None
,
out
:
Tensor
=
None
,
blocksize
=
64
,
compress_statistics
=
False
,
quant_type
=
'fp4'
,
quant_storage
=
torch
.
uint8
,
)
->
Tuple
[
Tensor
,
QuantState
]:
"""
"""
Quantize tensor A in blocks of 4-bit values.
Quantize tensor A in blocks of 4-bit values.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment