Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
e03b6bee
Unverified
Commit
e03b6bee
authored
Oct 28, 2025
by
Liana Koleva
Committed by
GitHub
Oct 28, 2025
Browse files
doc: improve modelopt error description (#12269)
parent
5e36a0b4
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
2 deletions
+8
-2
python/sglang/srt/configs/model_config.py
python/sglang/srt/configs/model_config.py
+8
-2
No files found.
python/sglang/srt/configs/model_config.py
View file @
e03b6bee
...
...
@@ -590,14 +590,20 @@ class ModelConfig:
return
# Check if ModelOpt quantization is specified
modelopt_quantization_specified
=
self
.
quantization
in
[
_MODELOPT_QUANTIZATION_METHODS
=
[
"modelopt"
,
"modelopt_fp8"
,
"modelopt_fp4"
,
]
modelopt_quantization_specified
=
(
self
.
quantization
in
_MODELOPT_QUANTIZATION_METHODS
)
if
not
modelopt_quantization_specified
:
raise
ValueError
(
"quantize_and_serve requires ModelOpt quantization"
)
raise
ValueError
(
"quantize_and_serve requires ModelOpt quantization (set with --quantization "
f
"{{
{
', '
.
join
(
sorted
(
_MODELOPT_QUANTIZATION_METHODS
))
}
}})"
)
# quantize_and_serve is disabled due to compatibility issues
raise
NotImplementedError
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment