Skip to content

GitLab

Commit 28450473 authored by Mostofa Patwary's avatar Mostofa Patwary
Browse files

addressed comments

parent c45109ed
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 1 deletion
tasks/orqa/supervised/finetune.py
View file @ 28450473
...@@ -45,7 +45,6 @@ def check_and_append_tensor_for_gather(group, rank, world_size, input_): ...@@ -45,7 +45,6 @@ def check_and_append_tensor_for_gather(group, rank, world_size, input_):
torch.distributed.all_gather(input_list, first_dim, group=group) torch.distributed.all_gather(input_list, first_dim, group=group)
all_input_list = torch.cat(input_list, dim=0).contiguous() all_input_list = torch.cat(input_list, dim=0).contiguous()
max_length = torch.max(all_input_list) max_length = torch.max(all_input_list)
min_length = torch.min(all_input_list)
# if the size are different than the max, extend the tensor # if the size are different than the max, extend the tensor
# accordingly # accordingly
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment