GitLab

* Add AdEMAMix optimizer

* Add PagedAdEMAMix32bit, AdEMAMix32bit

* Add PagedAdEMAMix32bit, AdEMAMix32bit

* AdEMAMix: add support for alpha/beta3 scheduling

* Update paged AdEMAMix

* optim, integration

* toctree

* feedback

* optims

* fix path

* fix path

* mdx

* fix path

* toctree

* fix

* optimizer, adagrad

* add init

* add

* more apis

* params

* clarify

* run pre-commit hooks

---------
Co-authored-by: Titus von Koeller <9048635+Titus-von-Koeller@users.noreply.github.com>

* add optional dependency for preview to environment.yml

* Add additional sections, first optimizers, MacOS WIP

* drafting + refactoring new docs

* some changes

* run pre-commit hooks

* add mention of pre-commit to contributing

* fix

* test autodoc

* new additions

* add subtilte

* add some content

* add more methods

* fix

* further docs updates

* Update _toctree.yml

* fix link

* run pre-commit hooks

* refactor + further docs

* Update README.md with new docs link
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* list of blog posts
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* list of blog posts
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* accept change suggestion
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* accept suggestion
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* accept suggestion
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Update docs/source/integrations.mdx
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* index instead of intro

* fixup README, add docs link

* add instructions for creating docstrings

* final polish (except integrations)

* fill out integrations section

---------
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>