- 18 May, 2020 2 commits
-
-
Funtowicz Morgan authored
* Adding optimizations block from ONNXRuntime. * Turn off external data format by default for PyTorch export. * Correct the way use_external_format is passed through the cmdline args.
-
Patrick von Platen authored
* Update README.md * Update README.md * Update README.md * Update README.md
-
- 15 May, 2020 1 commit
-
-
Nikita authored
-
- 14 May, 2020 2 commits
-
-
Morgan Funtowicz authored
-
Funtowicz Morgan authored
* Added generic ONNX conversion script for PyTorch model. * WIP initial TF support. * TensorFlow/Keras ONNX export working. * Print framework version info * Add possibility to check the model is correctly loading on ONNX runtime. * Remove quantization option. * Specify ONNX opset version when exporting. * Formatting. * Remove unused imports. * Make functions more generally reusable from other part of the code. * isort happy. * flake happy * Export only feature-extraction for now * Correctly check inputs order / filter before export. * Removed task variable * Fix invalid args call in load_graph_from_args. * Fix invalid args call in convert. * Fix invalid args call in infer_shapes. * Raise exception and catch in caller function instead of exit. * Add 04-onnx-export.ipynb notebook * More WIP on the notebook * Remove unused imports * Simplify & remove unused constants. * Export with constant_folding in PyTorch * Let's try to put function args in the right order this time ... * Disable external_data_format temporary * ONNX notebook draft ready. * Updated notebooks charts + wording * Correct error while exporting last chart in notebook. * Adressing @LysandreJik comment. * Set ONNX opset to 11 as default value. * Set opset param mandatory * Added ONNX export unittests * Quality. * flake8 happy * Add keras2onnx dependency on extras["tf"] * Pin keras2onnx on github master to v1.6.5 * Second attempt. * Third attempt. * Use the right repo URL this time ... * Do the same for onnxconverter-common * Added keras2onnx and onnxconveter-common to 1.7.0 to supports TF2.2 * Correct commit hash. * Addressing PR review: Optimization are enabled by default. * Addressing PR review: small changes in the notebook * setup.py comment about keras2onnx versioning.
-
- 13 May, 2020 1 commit
-
-
Patrick von Platen authored
* add first text for generation * add generation pipeline to usage * Created using Colaboratory * correct docstring * finish
-
- 28 Apr, 2020 1 commit
-
-
Stefan Schweter authored
-
- 16 Apr, 2020 1 commit
-
-
Jonathan Sum authored
Changing from "fine-grained token-leven" to "fine-grained token-level"
-
- 10 Apr, 2020 1 commit
-
-
Anthony MOI authored
-
- 06 Apr, 2020 1 commit
-
-
Lysandre Debut authored
* Update notebooks * From local to global link * from local links to *actual* global links
-
- 27 Mar, 2020 1 commit
-
-
Patrick von Platen authored
-
- 19 Mar, 2020 2 commits
-
-
Kyeongpil Kang authored
I found there are two grammar errors or typo issues in the explanation of the encoding properties. The original sentences: If your was made of multiple \"parts\" such as (question, context), then this would be a vector with for each token the segment it belongs to If your has been truncated into multiple subparts because of a length limit (for BERT for example the sequence length is limited to 512), this will contain all the remaining overflowing parts. I think "input" should be inserted after the phrase "If your".
-
Kyeongpil Kang authored
For the tutorial of "How to generate text", the URL link was wrong (it was linked to the tutorial of "How to train a language model"). I fixed the URL.
-
- 18 Mar, 2020 2 commits
-
-
Morgan Funtowicz authored
Remove hardcoded mask_token and use the value provided by the tokenizer.
-
Patrick von Platen authored
-
- 08 Mar, 2020 1 commit
-
-
Param bhavsar authored
-
- 05 Mar, 2020 4 commits
-
-
Morgan Funtowicz authored
Signed-off-by:Morgan Funtowicz <morgan@huggingface.co>
-
Morgan Funtowicz authored
Signed-off-by:Morgan Funtowicz <morgan@huggingface.co>
-
Morgan Funtowicz authored
Signed-off-by:Morgan Funtowicz <morgan@huggingface.co>
-
Morgan Funtowicz authored
Signed-off-by:Morgan Funtowicz <morgan@huggingface.co>
-
- 04 Mar, 2020 3 commits
-
-
Morgan Funtowicz authored
Signed-off-by:Morgan Funtowicz <morgan@huggingface.co>
-
Julien Chaumond authored
-
Funtowicz Morgan authored
* Added transformers-pytorch-cpu and gpu Docker images Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added automatic jupyter launch for Docker image. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Move image from alpine to Ubuntu to align with NVidia container images. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added TRANSFORMERS_VERSION argument to Dockerfile. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added Pytorch-GPU based Docker image Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added Tensorflow images. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Use python 3.7 as Tensorflow doesnt provide 3.8 compatible wheel. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Remove double FROM instructions on transformers-pytorch-cpu image. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added transformers-tensorflow-gpu Docker image. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * use the correct ubuntu version for tensorflow-gpu Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added pipelines example notebook Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added transformers-cpu and transformers-gpu (including both PyTorch and TensorFlow) images. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Docker images doesnt start jupyter notebook by default. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Tokenizers notebook Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Update images links Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Update Docker images to python 3.7.6 and transformers 2.5.1 Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added 02-transformers notebook. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Trying to realign 02-transformers notebook ? Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added Transformer image schema * Some tweaks on tokenizers notebook * Removed old notebooks. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Attempt to provide table of content for each notebooks Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Second attempt. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Reintroduce transformer image. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Keep trying Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * It's going to fly ! Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Remaining of the Table of Content Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Fix inlined elements for the table of content Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Removed anaconda dependencies for Docker images. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Removing notebooks ToC Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added LABEL to each docker image. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Removed old Dockerfile Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Directly use the context and include transformers from here. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Reduce overall size of compiled Docker images. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Install jupyter by default and use CMD for easier launching of the images. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Reduce number of layers in the images. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added README.md for notebooks. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Fix notebooks link in README Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Fix some wording issues. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Added blog notebooks too. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> * Addressing spelling errors in review comments. Signed-off-by:
Morgan Funtowicz <morgan@huggingface.co> Co-authored-by:
MOI Anthony <xn1t0x@gmail.com>
-
- 06 Jan, 2020 2 commits
-
-
alberduris authored
-
alberduris authored
-
- 05 Jul, 2019 1 commit
-
-
thomwolf authored
-
- 03 Jul, 2019 1 commit
-
-
thomwolf authored
-
- 24 Jun, 2019 1 commit
-
-
thomwolf authored
-
- 20 Jun, 2019 1 commit
-
-
chrislarson1 authored
-
- 26 Nov, 2018 1 commit
-
-
thomwolf authored
-
- 17 Nov, 2018 1 commit
-
-
thomwolf authored
-
- 16 Nov, 2018 2 commits
- 15 Nov, 2018 1 commit
-
-
thomwolf authored
-
- 06 Nov, 2018 1 commit
-
-
thomwolf authored
-
- 05 Nov, 2018 2 commits