"build_tools/vscode:/vscode.git/clone" did not exist on "2c1158214f276e73f6d800d77e16a69931e2fa8e"
Unverified Commit 921e4a81 authored by Ximingwang-09's avatar Ximingwang-09 Committed by GitHub
Browse files

[Docs]Delete duplicate content (#6146)


Co-authored-by: default avatarximing.wxm <ximing.wxm@antgroup.com>
parent 9d8ec2e6
...@@ -63,7 +63,6 @@ Please consult the documentation below and [server_args.py](https://github.com/s ...@@ -63,7 +63,6 @@ Please consult the documentation below and [server_args.py](https://github.com/s
| `kv_cache_dtype` | Dtype of the kv cache. | `auto` | | `kv_cache_dtype` | Dtype of the kv cache. | `auto` |
| `context_length` | The model's maximum context length. Defaults to None (will use the value from the model's config.json instead). Note that extending the default might lead to strange behavior. | None | | `context_length` | The model's maximum context length. Defaults to None (will use the value from the model's config.json instead). Note that extending the default might lead to strange behavior. | None |
| `device` | The device we put the model. | None | | `device` | The device we put the model. | None |
| `device` | The device we put the model. | None |
| `served_model_name` | Override the model name returned by the v1/models endpoint in OpenAI API server.| None | | `served_model_name` | Override the model name returned by the v1/models endpoint in OpenAI API server.| None |
| `is_embedding` | Set to `true` to perform [embedding](./openai_api_embeddings.ipynb) / [encode](https://docs.sglang.ai/backend/native_api#Encode-(embedding-model)) and [reward](https://docs.sglang.ai/backend/native_api#Classify-(reward-model)) tasks. | `False` | | `is_embedding` | Set to `true` to perform [embedding](./openai_api_embeddings.ipynb) / [encode](https://docs.sglang.ai/backend/native_api#Encode-(embedding-model)) and [reward](https://docs.sglang.ai/backend/native_api#Classify-(reward-model)) tasks. | `False` |
| `revision` | Adjust if a specific version of the model should be used. | None | | `revision` | Adjust if a specific version of the model should be used. | None |
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment