"...text-generation-inference.git" did not exist on "a6e4d63c86f4eeaae2ba1337a39f19d03bbd2277"
Unverified Commit cde02b06 authored by Chengxi Guo's avatar Chengxi Guo Committed by GitHub
Browse files

Fix kontext finetune issue when batch size >1 (#11921)



set drop_last to True
Signed-off-by: default avatarmymusise <mymusise1@gmail.com>
parent 5dc503aa
...@@ -1614,7 +1614,7 @@ def main(args): ...@@ -1614,7 +1614,7 @@ def main(args):
) )
if args.cond_image_column is not None: if args.cond_image_column is not None:
logger.info("I2I fine-tuning enabled.") logger.info("I2I fine-tuning enabled.")
batch_sampler = BucketBatchSampler(train_dataset, batch_size=args.train_batch_size, drop_last=False) batch_sampler = BucketBatchSampler(train_dataset, batch_size=args.train_batch_size, drop_last=True)
train_dataloader = torch.utils.data.DataLoader( train_dataloader = torch.utils.data.DataLoader(
train_dataset, train_dataset,
batch_sampler=batch_sampler, batch_sampler=batch_sampler,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment