Add RoBERTa to the comment as it was not explicit that RoBERTa don't use token_type_ids.
Attach a file by drag & drop or click to upload