GitLab

[2.0] - Split configuration and modeling files

Fix reference of import in XLM tokenization

XLNet bias fix on resize embeddings (cf #1124)

cc @n1t0 @lysandrejik @thomwolf

Fix byte-level BPE decoding error when using added tokens

distillation: fix ModuleNotFoundError error in token counts script

Pruning changes so that deleted heads are kept on save/load

Now raises a warning when a head to be deleted already has been deleted. An integration test verifying the total pipeline (-> from config -> save model -> load model -> additional head pruning) has been added.