Unverified Commit 208cb34c authored by Seth Kimmel's avatar Seth Kimmel Committed by GitHub
Browse files

[Doc]: Update tensorizer docs to include vllm[tensorizer] (#7889)


Co-authored-by: default avatarKaunil Dhruv <dhruv.kaunil@gmail.com>
parent b17046e2
...@@ -10,3 +10,6 @@ shorter Pod startup times and CPU memory usage. Tensor encryption is also suppor ...@@ -10,3 +10,6 @@ shorter Pod startup times and CPU memory usage. Tensor encryption is also suppor
For more information on CoreWeave's Tensorizer, please refer to For more information on CoreWeave's Tensorizer, please refer to
`CoreWeave's Tensorizer documentation <https://github.com/coreweave/tensorizer>`_. For more information on serializing a vLLM model, as well a general usage guide to using Tensorizer with vLLM, see `CoreWeave's Tensorizer documentation <https://github.com/coreweave/tensorizer>`_. For more information on serializing a vLLM model, as well a general usage guide to using Tensorizer with vLLM, see
the `vLLM example script <https://docs.vllm.ai/en/stable/getting_started/examples/tensorize_vllm_model.html>`_. the `vLLM example script <https://docs.vllm.ai/en/stable/getting_started/examples/tensorize_vllm_model.html>`_.
.. note::
Note that to use this feature you will need to install `tensorizer` by running `pip install vllm[tensorizer]`.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment