Skip to content

GitLab

"examples/pytorch/language-modeling/run_mlm.py" did not exist on "cf897246965bc740c2266dc5304e5eedb3a4349b"
Switch branch/tag
Find file BlameHistoryPermalink
  • Anton Vlasjuk's avatar
    Fix seq2seq collator padding (#30556) · 9112520b
    Anton Vlasjuk authored 
    * fix seq2seq data collator to respect the given padding strategy

further added tests for the seq2seq data collator in the style of the `data_collator_for_token_classification` (pt, tf, np)

* formatting and change bool equals "==" to "is"

* add missed return types in tests

* update numpy test as it can handle unequal shapes, not like pt or tf
    9112520b
test_data_collator.py 55.7 KB