Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
renzhc
diffusers_dcu
Commits
1fa56394
Unverified
Commit
1fa56394
authored
May 06, 2025
by
Aryan
Committed by
GitHub
May 06, 2025
Browse files
Fix torchao docs typo for fp8 granular quantization (#11473)
update
parent
ed4efbd6
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
docs/source/en/quantization/torchao.md
docs/source/en/quantization/torchao.md
+1
-1
No files found.
docs/source/en/quantization/torchao.md
View file @
1fa56394
...
...
@@ -85,7 +85,7 @@ The quantization methods supported are as follows:
|
**Category**
|
**Full Function Names**
|
**Shorthands**
|
|--------------|-------------------------|----------------|
|
**Integer quantization**
|
`int4_weight_only`
,
`int8_dynamic_activation_int4_weight`
,
`int8_weight_only`
,
`int8_dynamic_activation_int8_weight`
|
`int4wo`
,
`int4dq`
,
`int8wo`
,
`int8dq`
|
|
**Floating point 8-bit quantization**
|
`float8_weight_only`
,
`float8_dynamic_activation_float8_weight`
,
`float8_static_activation_float8_weight`
|
`float8wo`
,
`float8wo_e5m2`
,
`float8wo_e4m3`
,
`float8dq`
,
`float8dq_e4m3`
,
`float8_e4m3_tensor`
,
`float8_e4m3_row`
|
|
**Floating point 8-bit quantization**
|
`float8_weight_only`
,
`float8_dynamic_activation_float8_weight`
,
`float8_static_activation_float8_weight`
|
`float8wo`
,
`float8wo_e5m2`
,
`float8wo_e4m3`
,
`float8dq`
,
`float8dq_e4m3`
,
`float8
dq
_e4m3_tensor`
,
`float8
dq
_e4m3_row`
|
|
**Floating point X-bit quantization**
|
`fpx_weight_only`
|
`fpX_eAwB`
where
`X`
is the number of bits (1-7),
`A`
is exponent bits, and
`B`
is mantissa bits. Constraint:
`X == A + B + 1`
|
|
**Unsigned Integer quantization**
|
`uintx_weight_only`
|
`uint1wo`
,
`uint2wo`
,
`uint3wo`
,
`uint4wo`
,
`uint5wo`
,
`uint6wo`
,
`uint7wo`
|
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment