GitLab

Processor for SST-2 task

catch exception if pathlib not install

Fix top k generation for k != 0

Allow tokenization of sequences > 512 for caching

Issue#324: warmup linear fixes

add BertTokenizer flag to skip basic tokenization

For many applications requiring randomized data access, it's easier to cache the tokenized representations than the words. So why not turn this into a warning?

fix for negative learning rate with warmup_linear in BertAdam (happens when t_total is specified incorrectly)
+ copied BERT optimization warmup functions to OpenAI optimization file + added comments

fix for negative learning rate with warmup_linear in BertAdam (happens when t_total is specified incorrectly)
+ copied BERT optimization warmup functions to OpenAI optimization file + added comments

update documentation for gpt-2

Few small nits in GPT-2's README code examples

Update README.md