Commits · 7dc198feb7b68f08790823a06d42c7500ff446fa · OpenDAS / bitsandbytes

18 Apr, 2023 1 commit
- Added 32-bit optimizer for bfloat16 gradients. · 7dc198fe
  Tim Dettmers authored Apr 17, 2023
  
  7dc198fe
12 Apr, 2023 1 commit
- Fixed bias conversion in Linear4bit · b8ea2b41
  Tim Dettmers authored Apr 12, 2023
  
  b8ea2b41
07 Apr, 2023 1 commit
- Some fixed for loading PEFT modules with Params4bit. · e9fa03b7
  Tim Dettmers authored Apr 07, 2023
  
  e9fa03b7
04 Apr, 2023 1 commit
- Fixed ParamsIn4 init; fixed PyTorch 2.0 test failure. · 1ccb7bde
  Tim Dettmers authored Apr 03, 2023
  
  1ccb7bde
03 Apr, 2023 1 commit
- Refactor FP4 into 4Bit and integrate NF4 data type. · 4ea489d3
  Tim Dettmers authored Apr 03, 2023
  
  4ea489d3
02 Apr, 2023 4 commits
- First draft of NF4. · 64cc0592
  Tim Dettmers authored Apr 02, 2023
  
  64cc0592
- Added quantization tree generation. · 4ad999d1
  Tim Dettmers authored Apr 02, 2023
  
  4ad999d1
- Added normal with extra value. · 0d332a64
  Tim Dettmers authored Apr 02, 2023
  
  0d332a64
- Generalized FP4 data type. · 2dd5d690
  Tim Dettmers authored Apr 02, 2023
  
  2dd5d690
01 Apr, 2023 2 commits
- Added 8-bit compression to quantization statistics. · 51a21df7
  Tim Dettmers authored Apr 01, 2023
  
  51a21df7
- Added bf16 Adam. · c4cfe4fb
  Tim Dettmers authored Apr 01, 2023
  
  c4cfe4fb
30 Mar, 2023 1 commit
- Added normal quant. · 8645d1f7
  Tim Dettmers authored Mar 29, 2023
  
  8645d1f7
27 Mar, 2023 1 commit
- Some small changes. · 69810521
  Tim Dettmers authored Mar 27, 2023
  
  69810521
27 Feb, 2023 1 commit
- t5 model fix · 6c31a5fe
  Artidoro Pagnoni authored Feb 27, 2023
  
  6c31a5fe
24 Feb, 2023 1 commit
- Added cast to fp4 layer for speed. · 9851a10b
  Tim Dettmers authored Feb 24, 2023
  
  9851a10b
14 Feb, 2023 1 commit
- Fixed FP4 import and data type conversion in backward. · c93a90d0
  Tim Dettmers authored Feb 14, 2023
  
  c93a90d0
05 Feb, 2023 6 commits
- Added backprop test for Linear8bitLt and LinearFP4. · 7f0773ae
  Tim Dettmers authored Feb 05, 2023
  
  7f0773ae
- Added bias test for LinearFP4 and basic test. · c0c352b3
  Tim Dettmers authored Feb 05, 2023
  
  c0c352b3
- Fixed matmul_fp4 transpose. · c361f842
  Tim Dettmers authored Feb 05, 2023
  
  c361f842
- Added matmul_fp4 to the benchmark. · cfe4705e
  Tim Dettmers authored Feb 04, 2023
  
  cfe4705e
- Backward matmul_fp4 passes. · 13c0a4dc
  Tim Dettmers authored Feb 04, 2023
  
  13c0a4dc
- Forward matmul_fp4 tests pass. · 160a8358
  Tim Dettmers authored Feb 04, 2023
  
  160a8358
04 Feb, 2023 1 commit
- Added fp4 quant/dequant and dequant optimizations. · 3ac5840c
  Tim Dettmers authored Feb 04, 2023
  
  3ac5840c
02 Feb, 2023 3 commits
- Added version 0.37.0. · 0f5c3948
  Tim Dettmers authored Feb 01, 2023
  
  0f5c3948
- Added Int8 matmul support for all GPUs. Full backward support. · de535889
  Tim Dettmers authored Feb 01, 2023
  
  de535889
- Merge pull request #119 from stas00/patch-1 · 92ab6a8d
  Tim Dettmers authored Feb 01, 2023
```
improve install instructions
```
  92ab6a8d
05 Jan, 2023 1 commit
- improve install instructions · c5372a85
  Stas Bekman authored Jan 05, 2023
  
  c5372a85
04 Jan, 2023 2 commits
- Fixed issue where the CUDA SETUP was not printed. · 1341fb44
  Tim Dettmers authored Jan 04, 2023
  
  1341fb44
- Added CUDA 12.0 support; removed CC 3.0 support. · 3901ebf7
  Tim Dettmers authored Jan 04, 2023
  
  3901ebf7
03 Jan, 2023 6 commits
- Added error message for unexpected CUDA exception. · b3de1921
  Tim Dettmers authored Jan 03, 2023
  
  b3de1921
- Merge pull request #113 from Borzik/fix-warnings · 81990491
  Tim Dettmers authored Jan 03, 2023
```
Import missing warn function
```
  81990491
- Added additional error message for cudart error #85 · 9180b4cc
  Tim Dettmers authored Jan 03, 2023
  
  9180b4cc
- Added Python >= 3.8 requirement. · dfb049f8
  Tim Dettmers authored Jan 03, 2023
  
  dfb049f8
- Added error+instructions for unsupported CUDA 10.0 version #82 · 211ad594
  Tim Dettmers authored Jan 03, 2023
  
  211ad594
- import warn function · f3800bab
  Felix Borzik authored Jan 03, 2023
  
  f3800bab
02 Jan, 2023 5 commits
- Merge pull request #87 from lostmsu/main · 9d353ca7
  Tim Dettmers authored Jan 02, 2023
```
Add `device` and `dtype` parameters to `StableEmbedding`
```
  9d353ca7
- Default to CPU library on CUDA error+small refactor. · 7a6563b6
  Tim Dettmers authored Jan 02, 2023
  
  7a6563b6
- Merge pull request #110 from BlackHC/cublaslt_version · d9112dc5
  Tim Dettmers authored Jan 02, 2023
```
Improve cc version detection for cublaslt
```
  d9112dc5
- CUDASetup only executed once + fixed circular import. · 336e2469
  Tim Dettmers authored Jan 02, 2023
  
  336e2469
- Merge pull request #77 from Cyberes/main · df9a9b0c
  Tim Dettmers authored Jan 02, 2023
```
Allow hiding of the welcome message
```
  df9a9b0c