Commits · 4ea489d3bfc119ab4ceb50f999ce611690dc21e2 · OpenDAS / bitsandbytes

03 Apr, 2023 1 commit
- Refactor FP4 into 4Bit and integrate NF4 data type. · 4ea489d3
  Tim Dettmers authored Apr 03, 2023
  
  4ea489d3
02 Apr, 2023 4 commits
- First draft of NF4. · 64cc0592
  Tim Dettmers authored Apr 02, 2023
  
  64cc0592
- Added quantization tree generation. · 4ad999d1
  Tim Dettmers authored Apr 02, 2023
  
  4ad999d1
- Added normal with extra value. · 0d332a64
  Tim Dettmers authored Apr 02, 2023
  
  0d332a64
- Generalized FP4 data type. · 2dd5d690
  Tim Dettmers authored Apr 02, 2023
  
  2dd5d690
01 Apr, 2023 2 commits
- Added 8-bit compression to quantization statistics. · 51a21df7
  Tim Dettmers authored Apr 01, 2023
  
  51a21df7
- Added bf16 Adam. · c4cfe4fb
  Tim Dettmers authored Apr 01, 2023
  
  c4cfe4fb
30 Mar, 2023 1 commit
- Added normal quant. · 8645d1f7
  Tim Dettmers authored Mar 29, 2023
  
  8645d1f7
27 Mar, 2023 1 commit
- Some small changes. · 69810521
  Tim Dettmers authored Mar 27, 2023
  
  69810521
05 Feb, 2023 6 commits
- Added backprop test for Linear8bitLt and LinearFP4. · 7f0773ae
  Tim Dettmers authored Feb 05, 2023
  
  7f0773ae
- Added bias test for LinearFP4 and basic test. · c0c352b3
  Tim Dettmers authored Feb 05, 2023
  
  c0c352b3
- Fixed matmul_fp4 transpose. · c361f842
  Tim Dettmers authored Feb 05, 2023
  
  c361f842
- Added matmul_fp4 to the benchmark. · cfe4705e
  Tim Dettmers authored Feb 04, 2023
  
  cfe4705e
- Backward matmul_fp4 passes. · 13c0a4dc
  Tim Dettmers authored Feb 04, 2023
  
  13c0a4dc
- Forward matmul_fp4 tests pass. · 160a8358
  Tim Dettmers authored Feb 04, 2023
  
  160a8358
04 Feb, 2023 1 commit
- Added fp4 quant/dequant and dequant optimizations. · 3ac5840c
  Tim Dettmers authored Feb 04, 2023
  
  3ac5840c
02 Feb, 2023 1 commit
- Added Int8 matmul support for all GPUs. Full backward support. · de535889
  Tim Dettmers authored Feb 01, 2023
  
  de535889
02 Jan, 2023 1 commit
- CUDASetup only executed once + fixed circular import. · 336e2469
  Tim Dettmers authored Jan 02, 2023
  
  336e2469
19 Nov, 2022 1 commit
- Fixed k-bit quantization maps. · eb028e6e
  Tim Dettmers authored Nov 19, 2022
  
  eb028e6e
08 Nov, 2022 1 commit
- Fixed bug in cpu quant; faster GPU dequant. · 08fa2e7b
  Tim Dettmers authored Nov 07, 2022
  
  08fa2e7b
07 Nov, 2022 2 commits
- Fixed blockwise test and logic. · e0e697b1
  Tim Dettmers authored Nov 06, 2022
  
  e0e697b1
- Added blocksizes 2048, 1024, and 512 to blockwise quant. · 6bc2b992
  Tim Dettmers authored Nov 06, 2022
  
  6bc2b992
06 Nov, 2022 3 commits
- Added k<256 quantile estimate. · 2f2063ba
  Tim Dettmers authored Nov 06, 2022
  
  2f2063ba
- Added k-bit fp8 map. · 98cbc4bc
  Tim Dettmers authored Nov 06, 2022
  
  98cbc4bc
- Added k-bit linear quantization. · caf18325
  Tim Dettmers authored Nov 06, 2022
  
  caf18325
04 Nov, 2022 1 commit
- Added FP8 quantization map. · 1efb87d8
  Tim Dettmers authored Nov 03, 2022
  
  1efb87d8
27 Oct, 2022 3 commits
- Sort imports · 7a3c9af0
  Tom Aarsen authored Oct 27, 2022
```
Via isort
```
  7a3c9af0
- Simplify statements into equivalent, modern variants · 0b078403
  Tom Aarsen authored Oct 27, 2022
```
via pyupgrade --py37-plus. The changes e.g. are subclassing from object, calling super() with super(ThisClass, self), or old-style syntax formatting.
```
  0b078403
- Remove trailing whitespace & ensure newline at EOF · 1eec77d3
  Tom Aarsen authored Oct 27, 2022
  
  1eec77d3
25 Oct, 2022 1 commit
- Added CUDA SETUP instruction generator. · a371be30
  Tim Dettmers authored Oct 25, 2022
  
  a371be30
24 Oct, 2022 1 commit
- Isolated CUDASetup logging; all tests green. · df86625a
  Tim Dettmers authored Oct 24, 2022
  
  df86625a
20 Sep, 2022 3 commits
- try fp32 · 76ce9aa6
  justheuristic authored Sep 20, 2022
  
  76ce9aa6
- set threshold · 292a4787
  Tim Dettmers authored Sep 20, 2022
  
  292a4787
- review · a07825ac
  justheuristic authored Sep 20, 2022
  
  a07825ac
17 Sep, 2022 6 commits
- cast device · cff3a715
  justheuristic authored Sep 18, 2022
  
  cff3a715
- cast device · 32a9a88f
  justheuristic authored Sep 18, 2022
  
  32a9a88f
- cast device · 01b4c6a0
  justheuristic authored Sep 18, 2022
  
  01b4c6a0
- cast device · e4086a27
  justheuristic authored Sep 18, 2022
  
  e4086a27
- cast device · 725cc729
  justheuristic authored Sep 18, 2022
  
  725cc729
- cast before allclose · 28a9313d
  justheuristic authored Sep 18, 2022
  
  28a9313d