Commits · 21723f796a3951e56b77460e7d572c76619b773f · OpenDAS / bitsandbytes

30 Apr, 2023 1 commit
- 4-bit draft. · 21723f79
  Tim Dettmers authored Apr 29, 2023
  
  21723f79
29 Apr, 2023 5 commits
- Added bit template. · cad83994
  Tim Dettmers authored Apr 28, 2023
  
  cad83994
- New implementation for batch size 1. · f3e97ccb
  Tim Dettmers authored Apr 28, 2023
  
  f3e97ccb
- Added fp16 and thread/item template. · f6df4aef
  Tim Dettmers authored Apr 28, 2023
  
  f6df4aef
- Added template refactor. · 3aef7834
  Tim Dettmers authored Apr 28, 2023
  
  3aef7834
- First baseline kernel. · c1bfb210
  Tim Dettmers authored Apr 28, 2023
  
  c1bfb210
27 Apr, 2023 3 commits
- Adedd pipeline draft. · 9cab14a3
  Tim Dettmers authored Apr 27, 2023
  
  9cab14a3
- Added non-cutlass template. · d1c4c205
  Tim Dettmers authored Apr 27, 2023
  
  d1c4c205
- Best attempt at cutlass3. · 0afc8e9e
  Tim Dettmers authored Apr 26, 2023
  
  0afc8e9e
26 Apr, 2023 1 commit
- CUTLASS compiles. · 84964db9
  Tim Dettmers authored Apr 25, 2023
  
  84964db9
25 Apr, 2023 2 commits
- Added cutlass example. · 6e2544da
  Tim Dettmers authored Apr 25, 2023
  
  6e2544da
- Initial template. · 6bfd7a40
  Tim Dettmers authored Apr 25, 2023
  
  6bfd7a40
18 Apr, 2023 1 commit
- Added 32-bit optimizer for bfloat16 gradients. · 7dc198fe
  Tim Dettmers authored Apr 17, 2023
  
  7dc198fe
07 Apr, 2023 1 commit
- Some fixed for loading PEFT modules with Params4bit. · e9fa03b7
  Tim Dettmers authored Apr 07, 2023
  
  e9fa03b7
03 Apr, 2023 1 commit
- Refactor FP4 into 4Bit and integrate NF4 data type. · 4ea489d3
  Tim Dettmers authored Apr 03, 2023
  
  4ea489d3
02 Apr, 2023 2 commits
- First draft of NF4. · 64cc0592
  Tim Dettmers authored Apr 02, 2023
  
  64cc0592
- Generalized FP4 data type. · 2dd5d690
  Tim Dettmers authored Apr 02, 2023
  
  2dd5d690
01 Apr, 2023 1 commit
- Added bf16 Adam. · c4cfe4fb
  Tim Dettmers authored Apr 01, 2023
  
  c4cfe4fb
30 Mar, 2023 1 commit
- Added normal quant. · 8645d1f7
  Tim Dettmers authored Mar 29, 2023
  
  8645d1f7
27 Mar, 2023 1 commit
- Some small changes. · 69810521
  Tim Dettmers authored Mar 27, 2023
  
  69810521
04 Feb, 2023 1 commit
- Added fp4 quant/dequant and dequant optimizations. · 3ac5840c
  Tim Dettmers authored Feb 04, 2023
  
  3ac5840c
20 Nov, 2022 1 commit
- Added additional blocksizes: {64, 128, 256}. · c059bd28
  Tim Dettmers authored Nov 20, 2022
  
  c059bd28
08 Nov, 2022 1 commit
- Fixed bug in cpu quant; faster GPU dequant. · 08fa2e7b
  Tim Dettmers authored Nov 07, 2022
  
  08fa2e7b
07 Nov, 2022 1 commit
- Added blocksizes 2048, 1024, and 512 to blockwise quant. · 6bc2b992
  Tim Dettmers authored Nov 06, 2022
  
  6bc2b992
27 Oct, 2022 1 commit
- Remove trailing whitespace & ensure newline at EOF · 1eec77d3
  Tom Aarsen authored Oct 27, 2022
  
  1eec77d3
13 Sep, 2022 1 commit
- Fixed cpu blockwise quantization for small input tensors. · c05dd42d
  Tim Dettmers authored Sep 13, 2022
  
  c05dd42d
11 Sep, 2022 1 commit
- Fixed 2^31 max size issue for cpu blockwise quant. · 19a7adca
  Tim Dettmers authored Sep 11, 2022
  
  19a7adca
23 Aug, 2022 1 commit
- Fixed issue where Pascal was not displaying proper error. · ee5b947e
  Tim Dettmers authored Aug 23, 2022
  
  ee5b947e
17 Aug, 2022 1 commit
- Enhanced error handling in CUDA SETUP failures. · a6664de0
  Tim Dettmers authored Aug 16, 2022
  
  a6664de0
16 Aug, 2022 2 commits
- Added fused bias in dequant_mm. · dede3430
  Tim Dettmers authored Aug 16, 2022
  
  dede3430
- Removed storage() from get_ptr; added boilerplate for bias dequant_mm. · 1ed2fa2f
  Tim Dettmers authored Aug 16, 2022
  
  1ed2fa2f
06 Aug, 2022 1 commit
- Removed faulty asserts. · a4532c59
  Tim Dettmers authored Aug 06, 2022
  
  a4532c59
03 Aug, 2022 2 commits
- Added fixes for the case that matmullt dim A is zero, e.g. [0, 768]. · 451fd950
  Tim Dettmers authored Aug 03, 2022
  
  451fd950
- Added CUDA block assert and is_on_gpu check. · 2f01865a
  Tim Dettmers authored Aug 03, 2022
  
  2f01865a
27 Jul, 2022 2 commits
- Added col_ampere outlier extraction kernel. · 32fa459e
  Tim Dettmers authored Jul 26, 2022
  
  32fa459e
- Working outlier extraction for Turing. · bcab99ec
  Tim Dettmers authored Jul 26, 2022
  
  bcab99ec
26 Jul, 2022 3 commits
- Boilerplate and test for extract_outliers. · cbb901ac
  Tim Dettmers authored Jul 26, 2022
  
  cbb901ac
- Fixed cpuonly build. · 953b7285
  Tim Dettmers authored Jul 26, 2022
  
  953b7285
- Some progress on build script; added multi-cuda install script. · 9268dc9d
  Tim Dettmers authored Jul 25, 2022
  
  9268dc9d
25 Jul, 2022 1 commit
- Fixed makefile; fixed Ampere igemmlt_8 bug. · 8b1fd32e
  Tim Dettmers authored Jul 25, 2022
  
  8b1fd32e