Unverified Commit 6aad3872 authored by Yih-Dar's avatar Yih-Dar Committed by GitHub
Browse files

fix (#17337)


Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
parent 1762ded3
...@@ -942,8 +942,8 @@ class GenerationMixin: ...@@ -942,8 +942,8 @@ class GenerationMixin:
If set to float < 1, only the most probable tokens with probabilities that add up to `top_p` or higher If set to float < 1, only the most probable tokens with probabilities that add up to `top_p` or higher
are kept for generation. are kept for generation.
typical_p (`float`, *optional*, defaults to 1.0): typical_p (`float`, *optional*, defaults to 1.0):
The amount of probability mass from the original distribution to be considered in typical decoding. The amount of probability mass from the original distribution to be considered in typical decoding. If
If set to 1.0 it takes no effect. See [this paper](https://arxiv.org/pdf/2202.00666.pdf) for more details. set to 1.0 it takes no effect. See [this paper](https://arxiv.org/pdf/2202.00666.pdf) for more details.
repetition_penalty (`float`, *optional*, defaults to 1.0): repetition_penalty (`float`, *optional*, defaults to 1.0):
The parameter for repetition penalty. 1.0 means no penalty. See [this The parameter for repetition penalty. 1.0 means no penalty. See [this
paper](https://arxiv.org/pdf/1909.05858.pdf) for more details. paper](https://arxiv.org/pdf/1909.05858.pdf) for more details.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment