Commits · 264a948539d219e6b9a8fc8b9d92120d76b8878b · OpenDAS / bitsandbytes

02 May, 2023 7 commits
- 4-bit draft; 128 vector load 240. · 264a9485
  Tim Dettmers authored May 02, 2023
  
  264a9485
- Warp multi-specialization 240. · 869b7e83
  Tim Dettmers authored May 02, 2023
  
  869b7e83
- Shared memory efficient 240. · 77f15fdc
  Tim Dettmers authored May 02, 2023
  
  77f15fdc
- Correct implementation 240. · 394749db
  Tim Dettmers authored May 02, 2023
  
  394749db
- Initial. · 9aa232cc
  Tim Dettmers authored May 02, 2023
  
  9aa232cc
- Tighter and scaled error analysis. · 9192c9de
  Tim Dettmers authored May 02, 2023
  
  9192c9de
- Baseline for debugging. · f9bfea8f
  Tim Dettmers authored May 02, 2023
  
  f9bfea8f
01 May, 2023 3 commits
- Warp specalization 362. · 7cc8ff47
  Tim Dettmers authored May 01, 2023
  
  7cc8ff47
- Double frag 440. · c35ed09b
  Tim Dettmers authored Apr 30, 2023
  
  c35ed09b
- Slow tensor core solution. · ad07d254
  Tim Dettmers authored Apr 30, 2023
  
  ad07d254
30 Apr, 2023 1 commit
- 4-bit draft. · 21723f79
  Tim Dettmers authored Apr 29, 2023
  
  21723f79
29 Apr, 2023 4 commits
- Added bit template. · cad83994
  Tim Dettmers authored Apr 28, 2023
  
  cad83994
- New implementation for batch size 1. · f3e97ccb
  Tim Dettmers authored Apr 28, 2023
  
  f3e97ccb
- Added fp16 and thread/item template. · f6df4aef
  Tim Dettmers authored Apr 28, 2023
  
  f6df4aef
- First baseline kernel. · c1bfb210
  Tim Dettmers authored Apr 28, 2023
  
  c1bfb210
27 Apr, 2023 3 commits
- Adedd pipeline draft. · 9cab14a3
  Tim Dettmers authored Apr 27, 2023
  
  9cab14a3
- Added non-cutlass template. · d1c4c205
  Tim Dettmers authored Apr 27, 2023
  
  d1c4c205
- Best attempt at cutlass3. · 0afc8e9e
  Tim Dettmers authored Apr 26, 2023
  
  0afc8e9e
19 Apr, 2023 1 commit
- Added nested quantization for blockwise quantization. · 0f9d3020
  Tim Dettmers authored Apr 19, 2023
  
  0f9d3020
18 Apr, 2023 1 commit
- Added 32-bit optimizer for bfloat16 gradients. · 7dc198fe
  Tim Dettmers authored Apr 17, 2023
  
  7dc198fe
07 Apr, 2023 1 commit
- Some fixed for loading PEFT modules with Params4bit. · e9fa03b7
  Tim Dettmers authored Apr 07, 2023
  
  e9fa03b7
04 Apr, 2023 1 commit
- Fixed ParamsIn4 init; fixed PyTorch 2.0 test failure. · 1ccb7bde
  Tim Dettmers authored Apr 03, 2023
  
  1ccb7bde
03 Apr, 2023 1 commit
- Refactor FP4 into 4Bit and integrate NF4 data type. · 4ea489d3
  Tim Dettmers authored Apr 03, 2023
  
  4ea489d3
02 Apr, 2023 4 commits
- First draft of NF4. · 64cc0592
  Tim Dettmers authored Apr 02, 2023
  
  64cc0592
- Added quantization tree generation. · 4ad999d1
  Tim Dettmers authored Apr 02, 2023
  
  4ad999d1
- Added normal with extra value. · 0d332a64
  Tim Dettmers authored Apr 02, 2023
  
  0d332a64
- Generalized FP4 data type. · 2dd5d690
  Tim Dettmers authored Apr 02, 2023
  
  2dd5d690
01 Apr, 2023 2 commits
- Added 8-bit compression to quantization statistics. · 51a21df7
  Tim Dettmers authored Apr 01, 2023
  
  51a21df7
- Added bf16 Adam. · c4cfe4fb
  Tim Dettmers authored Apr 01, 2023
  
  c4cfe4fb
30 Mar, 2023 1 commit
- Added normal quant. · 8645d1f7
  Tim Dettmers authored Mar 29, 2023
  
  8645d1f7
27 Mar, 2023 1 commit
- Some small changes. · 69810521
  Tim Dettmers authored Mar 27, 2023
  
  69810521
05 Feb, 2023 6 commits
- Added backprop test for Linear8bitLt and LinearFP4. · 7f0773ae
  Tim Dettmers authored Feb 05, 2023
  
  7f0773ae
- Added bias test for LinearFP4 and basic test. · c0c352b3
  Tim Dettmers authored Feb 05, 2023
  
  c0c352b3
- Fixed matmul_fp4 transpose. · c361f842
  Tim Dettmers authored Feb 05, 2023
  
  c361f842
- Added matmul_fp4 to the benchmark. · cfe4705e
  Tim Dettmers authored Feb 04, 2023
  
  cfe4705e
- Backward matmul_fp4 passes. · 13c0a4dc
  Tim Dettmers authored Feb 04, 2023
  
  13c0a4dc
- Forward matmul_fp4 tests pass. · 160a8358
  Tim Dettmers authored Feb 04, 2023
  
  160a8358
04 Feb, 2023 1 commit
- Added fp4 quant/dequant and dequant optimizations. · 3ac5840c
  Tim Dettmers authored Feb 04, 2023
  
  3ac5840c
02 Feb, 2023 1 commit
- Added Int8 matmul support for all GPUs. Full backward support. · de535889
  Tim Dettmers authored Feb 01, 2023
  
  de535889
02 Jan, 2023 1 commit
- CUDASetup only executed once + fixed circular import. · 336e2469
  Tim Dettmers authored Jan 02, 2023
  
  336e2469