Blame · requirements.txt · a175a9dc0188a367400c2121391fa3abf536748e · chenpangpang / transformers · GitLab

Find file Normal view History Permalink

requirements.txt 270 Bytes

Newer Older

added version in __init__.py thomwolf committed Dec 13, 2018	1	`# PyTorch`
inidicate we only support pytorch 1.0.0+ now thomwolf committed Aug 05, 2019	2	`torch>=1.0.0`
preparing for first release thomwolf committed Nov 15, 2018	3	`# progress bars in model download and training scripts`
bump up version minor thomwolf committed Nov 17, 2018	4	`tqdm`
preparing for first release thomwolf committed Nov 15, 2018	5 6 7	`# Accessing files from S3 directly. boto3 # Used for downloading models over HTTP`
forgot to add regex to requirements :( thomwolf committed Feb 18, 2019	8 9	`requests # For OpenAI GPT`
add tokenizer and tests thomwolf committed Jun 21, 2019	10 11	`regex # For XLNet`
Tokenization behave the same as original XLM proprocessing for most languages... Shijie Wu committed Aug 23, 2019	12 13	`sentencepiece # For XLM`
Add custom tokenizer for zh and ja Shijie Wu committed Aug 23, 2019	14 15 16 17 18	`sacremoses pythainlp kytea nltk jieba`