GitLab

* Add build job for rocm

* Add rocm build script

* Copy shared obj file into output_dir

* upload build artifacts and enable wheels build

* Remove cuda build temporarily

* Add ROCm version to .so filename

* Add rocm_version to whls build

* Revert "Remove cuda build temporarily"

This reverts commit 1413c5f3a2aed51140b86daa8ee9283c67cce738.

* Add rocm_version env var

* Remove thrush header files

* Print node info

* print cuda node info

* Revert "print cuda node info"

This reverts commit cdb209a2eb896d9c4166f53e9b2aa580c10e42c0.

* Revert "Print node info"

This reverts commit 7e9a65c33f66fffcb14ee2438170718777c06022.

* Add rocm arch to compile command

* Rename .so files to rocm

* Update default gpu arch

* Skip cpu based igemmlt int tests on ROCm

* Update Documentation

* Update upstream repo name

* Update docs

* Update string format
Co-authored-by: Aarni Koskela <akx@iki.fi>

* Remove pre-release option for torch install

* Update pytorch install path
Co-authored-by: Titus <9048635+Titus-von-Koeller@users.noreply.github.com>

* Add messages for Heuristics error

* Remove toolcache for disk space

* print disk usage

* Clean disk space for linux

* Fix for ubuntu

* Add sudo for apt clean

* Update clean up disk list

* remove disk usage print

* Add BNB_BACKEND variable

* Update diagnostic functions for ROCm

* Fix tuple error

* Fix library detection bug for recursive and symlink cases

* fix pre-commit errors

* Remove recursive path lib search

* Create function for runtime lib patterns

* Update logger format
Co-authored-by: Aarni Koskela <akx@iki.fi>

* Update error reporting
Co-authored-by: Aarni Koskela <akx@iki.fi>

* Remove commented code
Co-authored-by: Aarni Koskela <akx@iki.fi>

* Update error reporting
Co-authored-by: Aarni Koskela <akx@iki.fi>

* Update error reporting

* Create hip diagnostics functions

* Fix Typo

* Fix pre-commit checks

* Enable 6.2 build

* Skip gemv 4 bit cpu test

* Update documentation for 6.2.0 pip install

* Update README for default branch change

* Fix typo

* Sync README with upstream

* Remove depth

---------
Co-authored-by: Aarni Koskela <akx@iki.fi>
Co-authored-by: Titus <9048635+Titus-von-Koeller@users.noreply.github.com>
Co-authored-by: Aswin John Mathews <81309834+amathews-amd@users.noreply.github.com>
Co-authored-by: root <root@banff-cyxtera-s78-4.ctr.dcgpu>

* refine docs for multi-backend alpha release

* docs: further tweaks to multi-backend alpha docs

* docs: further tweaks to multi-backend alpha docs

* docs: further tweaks to multi-backend alpha docs

* docs: add multi-backend feedback links

* docs: add request for contributions

* docs: small fixes

* docs: small fixes

* docs: add info about `main` continuous build

* docs: further tweaks to multi-backend alpha docs

* docs: further tweaks to multi-backend alpha docs

* cpu benchmark

* try to fix formatting

* cleanup

* cleanup

---------
Co-authored-by: Titus <9048635+Titus-von-Koeller@users.noreply.github.com>

* Add AdEMAMix optimizer

* Add PagedAdEMAMix32bit, AdEMAMix32bit

* Add PagedAdEMAMix32bit, AdEMAMix32bit

* AdEMAMix: add support for alpha/beta3 scheduling

* Update paged AdEMAMix

* Add CUDA 12.5 builds and enable CUDA 12.4 on Windows

* Update install doc

* cpu install guide

* update readme

* fix format

* fix format

* fix typo

* add windows guide

* fix readme to pip install . instead of building wheel

* Update docs/source/installation.mdx
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/installation.mdx
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/installation.mdx
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* (docs) integrations: fix omission in bf16 related warning

* (docs) integrations: further clarifications to prior fix

* (docs) integrations: fix punctuation
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* (docs) integrations: fix omitted code formatting

---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* split build from source off

* validated compilers

* Add CUDA 12.4 download to utility script, docs

* (ci) Add CUDA 12.4.0 build to workflow

* Apply ruff format to install_cuda.py

* optim, integration

* toctree

* feedback

* optims

* fix path

* fix path

* mdx

* fix path

* toctree

* fix

* optimizer, adagrad

* add init

* add

* more apis

* params

* clarify

* run pre-commit hooks

---------
Co-authored-by: Titus von Koeller <9048635+Titus-von-Koeller@users.noreply.github.com>

* improve accelerate reference in docs

* Apply suggestions from code review
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* fix spelling

---------
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* lit-gpt integration

* mention PT lightning

(misc) Update CUDA download URLs

* Update installation instructions

* Update docs/source/installation.mdx
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Update installation.mdx

* Update docs/source/installation.mdx
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Update installation.mdx

* Update installation.mdx

---------
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Updated compiler instructuins

* Thank you, linter

* add anchor link

* fix typo in link

* links to subheadings don't work

* Delete Makefile

* Update installation.mdx

* Update docs/source/installation.mdx

* Update docs/source/installation.mdx

* Update docs/source/installation.mdx

* Update docs/source/installation.mdx

Co-authored-by: Titus von Koeller <titus@vonkoeller.com>

fix erroneous correction

* add optional dependency for preview to environment.yml

* Add additional sections, first optimizers, MacOS WIP

* drafting + refactoring new docs

* some changes

* run pre-commit hooks

* add mention of pre-commit to contributing

* fix

* test autodoc

* new additions

* add subtilte

* add some content

* add more methods

* fix

* further docs updates

* Update _toctree.yml

* fix link

* run pre-commit hooks

* refactor + further docs

* Update README.md with new docs link
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* list of blog posts
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* list of blog posts
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* accept change suggestion
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* accept suggestion
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* accept suggestion
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Update docs/source/integrations.mdx
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* index instead of intro

* fixup README, add docs link

* add instructions for creating docstrings

* final polish (except integrations)

* fill out integrations section

---------
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>