Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
87d08f4b
Commit
87d08f4b
authored
Oct 15, 2021
by
rprenger
Browse files
Fixing a bug in merge
parent
803ae5ee
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
megatron/text_generation/api.py
megatron/text_generation/api.py
+1
-1
No files found.
megatron/text_generation/api.py
View file @
87d08f4b
...
@@ -93,7 +93,7 @@ def generate(model,
...
@@ -93,7 +93,7 @@ def generate(model,
# Make sure input params are avaialble to all ranks.
# Make sure input params are avaialble to all ranks.
values
=
[
tokens_to_generate
,
values
=
[
tokens_to_generate
,
return_output_log_probs
,
return_output_log_probs
,
greedy_sampling
,
top_k_sampling
,
top_p_sampling
,
top_k_sampling
,
top_p_sampling
,
temperature
,
add_BOS
,
use_eod_token_for_early_termination
,
just_score
]
temperature
,
add_BOS
,
use_eod_token_for_early_termination
,
just_score
]
values_float_tensor
=
broadcast_float_list
(
8
,
float_list
=
values
)
values_float_tensor
=
broadcast_float_list
(
8
,
float_list
=
values
)
tokens_to_generate
=
int
(
values_float_tensor
[
0
].
item
())
tokens_to_generate
=
int
(
values_float_tensor
[
0
].
item
())
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment