Unverified Commit 637093ae authored by Nir's avatar Nir Committed by GitHub
Browse files

docs: update fastsafetensors usage instructions (#22891)


Signed-off-by: default avatarNir Levy <bhr166@gmail.com>
parent 33c63e95
......@@ -2,4 +2,5 @@ Loading Model weights with fastsafetensors
===================================================================
Using fastsafetensors library enables loading model weights to GPU memory by leveraging GPU direct storage. See [their GitHub repository](https://github.com/foundation-model-stack/fastsafetensors) for more details.
For enabling this feature, set the environment variable ``USE_FASTSAFETENSOR`` to ``true``
To enable this feature, use the ``--load-format fastsafetensors`` command-line argument
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment