Unverified Commit eb8ef422 authored by Reid's avatar Reid Committed by GitHub
Browse files

[doc] add download path tips (#17013)


Signed-off-by: default avatarreidliu41 <reid201711@gmail.com>
Co-authored-by: default avatarreidliu41 <reid201711@gmail.com>
parent 56a73526
...@@ -133,7 +133,7 @@ class MyConfig(PretrainedConfig): ...@@ -133,7 +133,7 @@ class MyConfig(PretrainedConfig):
### Hugging Face Hub ### Hugging Face Hub
By default, vLLM loads models from [Hugging Face (HF) Hub](https://huggingface.co/models). By default, vLLM loads models from [Hugging Face (HF) Hub](https://huggingface.co/models). To change the download path for models, you can set the `HF_HOME` environment variable; for more details, refer to [their official documentation](https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables#hfhome).
To determine whether a given model is natively supported, you can check the `config.json` file inside the HF repository. To determine whether a given model is natively supported, you can check the `config.json` file inside the HF repository.
If the `"architectures"` field contains a model architecture listed below, then it should be natively supported. If the `"architectures"` field contains a model architecture listed below, then it should be natively supported.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment