Unverified Commit fd222206 authored by bingps's avatar bingps Committed by GitHub
Browse files

[Doc] Installed version of llmcompressor for int8/fp8 quantization (#11103)


Signed-off-by: default avatarGuangda Liu <bingps@users.noreply.github.com>
Co-authored-by: default avatarGuangda Liu <bingps@users.noreply.github.com>
parent b2f77545
......@@ -45,7 +45,7 @@ To produce performant FP8 quantized models with vLLM, you'll need to install the
.. code-block:: console
$ pip install llmcompressor==0.1.0
$ pip install llmcompressor
Quantization Process
--------------------
......
......@@ -19,7 +19,7 @@ To use INT8 quantization with vLLM, you'll need to install the `llm-compressor <
.. code-block:: console
$ pip install llmcompressor==0.1.0
$ pip install llmcompressor
Quantization Process
--------------------
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment