GitLab

Now raises a warning when a head to be deleted already has been deleted. An integration test verifying the total pipeline (-> from config -> save model -> load model -> additional head pruning) has been added.

See #1089

cc @thomwolf @lysandrejik

Also @dhpollack

Instead we correctly store it on the config

(regenerating the hosted config files)

cc @lysandrejik

Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification

fp16 max number is 65504, the original 1e30 will cause Nan in fp16