Commits · 2bce175d156b5c5c1be925cb57fe33215675fafd · OpenDAS / bitsandbytes

24 May, 2023 1 commit
- Fixed Makefile. · 2bce175d
  Tim Dettmers authored May 23, 2023
  
  2bce175d
07 May, 2023 4 commits
- Fixed gradient accumulation test. · 4bd11518
  Tim Dettmers authored May 07, 2023
  
  4bd11518
- Merge remote-tracking branch 'origin/main' into merge · 675baa79
  Tim Dettmers authored May 07, 2023
  
  675baa79
- Fixed prefetch bug for non-paged tensors; added benchmark. · f64cfe65
  Tim Dettmers authored May 06, 2023
  
  f64cfe65
- Changed prefetching. · 41a9c708
  Tim Dettmers authored May 06, 2023
  
  41a9c708
06 May, 2023 2 commits
- Added paged optimizers. · 44d68ff2
  Tim Dettmers authored May 06, 2023
  
  44d68ff2
- Added paging. · ec38ba95
  Tim Dettmers authored May 06, 2023
  
  ec38ba95
02 May, 2023 9 commits
- 4-bit draft; 128 vector load 240. · 264a9485
  Tim Dettmers authored May 02, 2023
  
  264a9485
- Warp multi-specialization 240. · 869b7e83
  Tim Dettmers authored May 02, 2023
  
  869b7e83
- Shared memory efficient 240. · 77f15fdc
  Tim Dettmers authored May 02, 2023
  
  77f15fdc
- A tile multi-tiling. · 89cccd81
  Tim Dettmers authored May 02, 2023
  
  89cccd81
- Removed uncessary sync. · 4decb3cc
  Tim Dettmers authored May 02, 2023
  
  4decb3cc
- Correct implementation 240. · 394749db
  Tim Dettmers authored May 02, 2023
  
  394749db
- Initial. · 9aa232cc
  Tim Dettmers authored May 02, 2023
  
  9aa232cc
- Tighter and scaled error analysis. · 9192c9de
  Tim Dettmers authored May 02, 2023
  
  9192c9de
- Baseline for debugging. · f9bfea8f
  Tim Dettmers authored May 02, 2023
  
  f9bfea8f
01 May, 2023 9 commits
- 8x32 240 6 warps. · 7bfa09d0
  Tim Dettmers authored May 01, 2023
  
  7bfa09d0
- 16x16 240. · 3d4a2ead
  Tim Dettmers authored May 01, 2023
  
  3d4a2ead
- Warp specalization 362. · 7cc8ff47
  Tim Dettmers authored May 01, 2023
  
  7cc8ff47
- Halved shared memory 466. · cabcd9b9
  Tim Dettmers authored Apr 30, 2023
  
  cabcd9b9
- 64 threads, high smem, 434. · 30d03e02
  Tim Dettmers authored Apr 30, 2023
  
  30d03e02
- Fixed bank conflicts in non-vector load 422. · e01d4e03
  Tim Dettmers authored Apr 30, 2023
  
  e01d4e03
- Double frag 440. · c35ed09b
  Tim Dettmers authored Apr 30, 2023
  
  c35ed09b
- Slow non-vector 530. · 604bb3fb
  Tim Dettmers authored Apr 30, 2023
  
  604bb3fb
- Slow tensor core solution. · ad07d254
  Tim Dettmers authored Apr 30, 2023
  
  ad07d254
30 Apr, 2023 1 commit
- 4-bit draft. · 21723f79
  Tim Dettmers authored Apr 29, 2023
  
  21723f79
29 Apr, 2023 5 commits
- Added bit template. · cad83994
  Tim Dettmers authored Apr 28, 2023
  
  cad83994
- New implementation for batch size 1. · f3e97ccb
  Tim Dettmers authored Apr 28, 2023
  
  f3e97ccb
- Added fp16 and thread/item template. · f6df4aef
  Tim Dettmers authored Apr 28, 2023
  
  f6df4aef
- Added template refactor. · 3aef7834
  Tim Dettmers authored Apr 28, 2023
  
  3aef7834
- First baseline kernel. · c1bfb210
  Tim Dettmers authored Apr 28, 2023
  
  c1bfb210
27 Apr, 2023 3 commits
- Adedd pipeline draft. · 9cab14a3
  Tim Dettmers authored Apr 27, 2023
  
  9cab14a3
- Added non-cutlass template. · d1c4c205
  Tim Dettmers authored Apr 27, 2023
  
  d1c4c205
- Best attempt at cutlass3. · 0afc8e9e
  Tim Dettmers authored Apr 26, 2023
  
  0afc8e9e
26 Apr, 2023 1 commit
- CUTLASS compiles. · 84964db9
  Tim Dettmers authored Apr 25, 2023
  
  84964db9
25 Apr, 2023 2 commits
- Added cutlass example. · 6e2544da
  Tim Dettmers authored Apr 25, 2023
  
  6e2544da
- Initial template. · 6bfd7a40
  Tim Dettmers authored Apr 25, 2023
  
  6bfd7a40
19 Apr, 2023 1 commit
- Added nested quantization for blockwise quantization. · 0f9d3020
  Tim Dettmers authored Apr 19, 2023
  
  0f9d3020
18 Apr, 2023 1 commit
- Added 32-bit optimizer for bfloat16 gradients. · 7dc198fe
  Tim Dettmers authored Apr 17, 2023
  
  7dc198fe
12 Apr, 2023 1 commit
- Added last SwitchBack refactors. All tests green. · 9e7cdc9e
  Tim Dettmers authored Apr 12, 2023
  
  9e7cdc9e