Update README.md

fd7fc9ba · echo840 · GitHub · 3d3a46ae · fd7fc9ba
Unverified Commit fd7fc9ba authored Jan 25, 2024 by echo840 Committed by GitHub Jan 25, 2024
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

README.md README.md +1 -1

No files found.
--- a/README.md
+++ b/README.md
@@ -183,7 +183,7 @@ pred = model.generate(
            attention_mask=attention_mask.cuda(),
            do_sample=False,
            num_beams=1,
-            max_new_tokens=10,
+            max_new_tokens=512,
            min_new_tokens=1,
            length_penalty=1,
            num_return_sequences=1,