Skip to content

GitLab

Commit f21a6628 authored by Mostofa Patwary's avatar Mostofa Patwary
Browse files

updated the evaluation script for retriver

parent dfb6a9b3
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 1 deletion
megatron/data/biencoder_dataset_utils.py
View file @ f21a6628
...@@ -20,7 +20,6 @@ def make_attention_mask(source_block, target_block): ...@@ -20,7 +20,6 @@ def make_attention_mask(source_block, target_block):
# (source_length, target_length) # (source_length, target_length)
return mask return mask
def get_one_epoch_dataloader(dataset, micro_batch_size=None): def get_one_epoch_dataloader(dataset, micro_batch_size=None):
"""Specifically one epoch to be used in an indexing job.""" """Specifically one epoch to be used in an indexing job."""
args = get_args() args = get_args()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment