"vscode:/vscode.git/clone" did not exist on "19b927e52df8400084df1c8116af7d6f0a5f5d15"
Unverified Commit 7feae92c authored by Alex Brooks's avatar Alex Brooks Committed by GitHub
Browse files

[Doc] Move todo out of beam search docstring (#17183)


Signed-off-by: default avatarAlex-Brooks <Alex.Brooks@ibm.com>
parent f851b842
...@@ -519,11 +519,9 @@ class LLM: ...@@ -519,11 +519,9 @@ class LLM:
prompts: A list of prompts. Each prompt can be a string or a list prompts: A list of prompts. Each prompt can be a string or a list
of token IDs. of token IDs.
params: The beam search parameters. params: The beam search parameters.
TODO: how does beam search work together with length penalty, frequency
penalty, and stopping criteria, etc.?
""" """
# TODO: how does beam search work together with length penalty,
# frequency, penalty, and stopping criteria, etc.?
beam_width = params.beam_width beam_width = params.beam_width
max_tokens = params.max_tokens max_tokens = params.max_tokens
temperature = params.temperature temperature = params.temperature
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment