GitLab

This allows moving the file instead of copying it, which is more
reliable. Also it avoids writing large amounts of data to /tmp,
which may not be large enough to accomodate it.

Refs #2222.

This looks like it could be expensive, so don't run it twice.

cc @lysandrejik

- Create the output directory (whose name is passed by the user in the "save_directory" parameter) where it will be saved encoder and decoder, if not exists.
- Empty the output directory, if it contains any files or subdirectories.
- Create the "encoder" directory inside "save_directory", if not exists.
- Create the "decoder" directory inside "save_directory", if not exists.
- Save the encoder and the decoder in the previous two directories, respectively.

Fix Camembert and XLM-R `decode` method- Fix NER pipeline alignement

Numpy compatibility for sentence piece

convert to int earlier

fixing xlm-roberta tokenizer max_length and automodels

[2.2] - Command-line interface - Pipeline class

Add support for XLM-RoBERTa