Unverified Commit 6e195eb9 authored by Jader Martins's avatar Jader Martins Committed by GitHub
Browse files

docs for typical decoding (#17186)


Co-authored-by: default avatarJader Martins <jadermcs94@gmail.com>
parent 060fe61d
...@@ -941,6 +941,9 @@ class GenerationMixin: ...@@ -941,6 +941,9 @@ class GenerationMixin:
top_p (`float`, *optional*, defaults to 1.0): top_p (`float`, *optional*, defaults to 1.0):
If set to float < 1, only the most probable tokens with probabilities that add up to `top_p` or higher If set to float < 1, only the most probable tokens with probabilities that add up to `top_p` or higher
are kept for generation. are kept for generation.
typical_p (`float`, *optional*, defaults to 1.0):
The amount of probability mass from the original distribution to be considered in typical decoding.
If set to 1.0 it takes no effect. See [this paper](https://arxiv.org/pdf/2202.00666.pdf) for more details.
repetition_penalty (`float`, *optional*, defaults to 1.0): repetition_penalty (`float`, *optional*, defaults to 1.0):
The parameter for repetition penalty. 1.0 means no penalty. See [this The parameter for repetition penalty. 1.0 means no penalty. See [this
paper](https://arxiv.org/pdf/1909.05858.pdf) for more details. paper](https://arxiv.org/pdf/1909.05858.pdf) for more details.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment