Unverified Commit ad46550d authored by yang_zcybb's avatar yang_zcybb Committed by GitHub
Browse files

[Doc] Fix typo in backend/sampling_params (#3835)


Co-authored-by: default avataryangzhice.124 <yangzhice.124@bytedance.com>
parent 14344caa
...@@ -8,7 +8,7 @@ If you want a high-level endpoint that can automatically handle chat templates, ...@@ -8,7 +8,7 @@ If you want a high-level endpoint that can automatically handle chat templates,
The `/generate` endpoint accepts the following parameters in JSON format. For in detail usage see the [native api doc](./native_api.ipynb). The `/generate` endpoint accepts the following parameters in JSON format. For in detail usage see the [native api doc](./native_api.ipynb).
* `prompt: Optional[Union[List[str], str]] = None` The input prompt. Can be a single prompt or a batch of prompts. * `text: Optional[Union[List[str], str]] = None` The input prompt. Can be a single prompt or a batch of prompts.
* `input_ids: Optional[Union[List[List[int]], List[int]]] = None` Alternative to `text`. Specify the input as token IDs instead of text. * `input_ids: Optional[Union[List[List[int]], List[int]]] = None` Alternative to `text`. Specify the input as token IDs instead of text.
* `sampling_params: Optional[Union[List[Dict], Dict]] = None` The sampling parameters as described in the sections below. * `sampling_params: Optional[Union[List[Dict], Dict]] = None` The sampling parameters as described in the sections below.
* `return_logprob: Optional[Union[List[bool], bool]] = None` Whether to return log probabilities for tokens. * `return_logprob: Optional[Union[List[bool], bool]] = None` Whether to return log probabilities for tokens.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment