GitLab

fixed the broken links belogs to dataset library of transformers

Add missing spaces in adjacent strings

* docs: add space to docs

* docs: remove reduntant space

* Result of black 23.1

* Update target to Python 3.7

* Switch flake8 to ruff

* Configure isort

* Configure isort

* Apply isort with line limit

* Put the right black version

* adapt black in check copies

* Fix copies

* Fix typo

* Update README.md

* Update run_mlm_flax_stream.py

* Update README.md

* [JAX] Replace all jax.tree_* calls with jax.tree_util.tree_*

* fix double tree_util

* Fix RESOURCE_EXHAUSTED error for large datasets on Flax example scripts

* using np.permutation for creating batch_idx

* train_samples_idx -> training_samples_idx

* fix type hints

* fixed bug run_mlm_flax_stream.py

Fixed bug caused by an update to tokenizer keys introduced in recent transformers versions (between `4.6.2` and `4.18.0`) where additional keys were introduced to the tokenizer output.

* Update run_mlm_flax_stream.py

* adding missing paranthesis

* formatted to black

* remove cols from dataset instead

* reformat to black

* moved rem. columns to map

* formatted to black
Co-authored-by: KennethEnevoldsen <kennethcenevolsen@gmail.com>

* Black preview

* Fixup too!

* Fix check copies

* Use the same version as the CI

* Bump black

* Updates the default branch from master to main

* Links from `master` to `main`

* Typo

* Update examples/flax/README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Replace outdated model tags with their now-canonical pipeline types

* spam the CI till it's green

* fix_torch_device_generate_test

* remove @

* finish

* fix_torch_device_generate_test

* remove @

* upload

* finish dataset streaming

* adapt readme

* finish

* up

* up

* up

* up

* Apply suggestions from code review

* finish

* make style

* make style2

* finish
Co-authored-by: Patrick von Platen <patrick@huggingface.co>