Fix check for max_seqlen.
Previously, long sequences were not excluded from the script. This commit changes the comparison to exclude sequences with length greater than args.max_seqlen.
Showing
Please register or sign in to comment
Previously, long sequences were not excluded from the script. This commit changes the comparison to exclude sequences with length greater than args.max_seqlen.