Commits · c82f51c0f784d8a43ebcb9cdefbf94e3f3b9c6c3 · OpenDAS / bitsandbytes

19 Jul, 2023 1 commit
- Increased occupancy. · c82f51c0
  Tim Dettmers authored Jul 19, 2023
  
  c82f51c0
17 Jul, 2023 1 commit
- Guard for prefetchAsync GPU capability. #470 #451 #477 · 7be5f2c7
  Tim Dettmers authored Jul 16, 2023
  
  7be5f2c7
11 Jul, 2023 1 commit
- Added more extensive gemv tests; blocksize guard for gemv. · ba51d95d
  Tim Dettmers authored Jul 11, 2023
  
  ba51d95d
10 Jul, 2023 5 commits
- Removed debugging statement. · a26a321e
  Tim Dettmers authored Jul 10, 2023
  
  a26a321e
- Fixed accidential deletion of limits in kernel. · 306f6b23
  Tim Dettmers authored Jul 10, 2023
  
  306f6b23
- Fixed potential memory leak. · 2221f4ce
  Tim Dettmers authored Jul 10, 2023
  
  2221f4ce
- Added ARCH guard for bfloat16 computations. · 1c774ece
  Tim Dettmers authored Jul 10, 2023
  
  1c774ece
- Added fp32 compute type for gemv_4bit. · 5fab6734
  Tim Dettmers authored Jul 09, 2023
  
  5fab6734
09 Jul, 2023 2 commits
- Added FP4 fast inference support. · 94168d79
  Tim Dettmers authored Jul 09, 2023
  
  94168d79
- Added abitrary data types; fixed a bug for small matrices. · 4b88d69d
  Tim Dettmers authored Jul 09, 2023
  
  4b88d69d
08 Jul, 2023 2 commits
- Turning optimization (float accumulation). 185 vs 50. · eefbf602
  Tim Dettmers authored Jul 08, 2023
  
  eefbf602
- Added warp_shuffle indexing 185 vs 54. · 7e49b5b9
  Tim Dettmers authored Jul 08, 2023
  
  7e49b5b9
05 Jul, 2023 1 commit
- Added bfloat16 quantizations and tests. · 02fd80cb
  Tim Dettmers authored Jul 04, 2023
  
  02fd80cb
04 Jul, 2023 2 commits
- Vectorized loads, conflict free NF4; 52 vs 172. · dfe6900b
  Tim Dettmers authored Jul 04, 2023
  
  dfe6900b
- Initial 4-bit naive batch size 1, 81 vs 185. · f89ff93e
  Tim Dettmers authored Jul 03, 2023
  
  f89ff93e
31 May, 2023 3 commits
- Added debugging functions. · e54d2730
  Tim Dettmers authored May 30, 2023
  
  e54d2730
- Added lookup table. · b7f04e2a
  Tim Dettmers authored May 30, 2023
  
  b7f04e2a
- Added changes for deployment. · ac5550a0
  Tim Dettmers authored May 30, 2023
  
  ac5550a0
24 May, 2023 1 commit
- Added PagedLion and bf16 Lion. · 1b8772a8
  Tim Dettmers authored May 23, 2023
  
  1b8772a8
06 May, 2023 1 commit
- Added paging. · ec38ba95
  Tim Dettmers authored May 06, 2023
  
  ec38ba95
02 May, 2023 8 commits
- 4-bit draft; 128 vector load 240. · 264a9485
  Tim Dettmers authored May 02, 2023
  
  264a9485
- Warp multi-specialization 240. · 869b7e83
  Tim Dettmers authored May 02, 2023
  
  869b7e83
- Shared memory efficient 240. · 77f15fdc
  Tim Dettmers authored May 02, 2023
  
  77f15fdc
- A tile multi-tiling. · 89cccd81
  Tim Dettmers authored May 02, 2023
  
  89cccd81
- Removed uncessary sync. · 4decb3cc
  Tim Dettmers authored May 02, 2023
  
  4decb3cc
- Correct implementation 240. · 394749db
  Tim Dettmers authored May 02, 2023
  
  394749db
- Tighter and scaled error analysis. · 9192c9de
  Tim Dettmers authored May 02, 2023
  
  9192c9de
- Baseline for debugging. · f9bfea8f
  Tim Dettmers authored May 02, 2023
  
  f9bfea8f
01 May, 2023 9 commits
- 8x32 240 6 warps. · 7bfa09d0
  Tim Dettmers authored May 01, 2023
  
  7bfa09d0
- 16x16 240. · 3d4a2ead
  Tim Dettmers authored May 01, 2023
  
  3d4a2ead
- Warp specalization 362. · 7cc8ff47
  Tim Dettmers authored May 01, 2023
  
  7cc8ff47
- Halved shared memory 466. · cabcd9b9
  Tim Dettmers authored Apr 30, 2023
  
  cabcd9b9
- 64 threads, high smem, 434. · 30d03e02
  Tim Dettmers authored Apr 30, 2023
  
  30d03e02
- Fixed bank conflicts in non-vector load 422. · e01d4e03
  Tim Dettmers authored Apr 30, 2023
  
  e01d4e03
- Double frag 440. · c35ed09b
  Tim Dettmers authored Apr 30, 2023
  
  c35ed09b
- Slow non-vector 530. · 604bb3fb
  Tim Dettmers authored Apr 30, 2023
  
  604bb3fb
- Slow tensor core solution. · ad07d254
  Tim Dettmers authored Apr 30, 2023
  
  ad07d254
30 Apr, 2023 1 commit
- 4-bit draft. · 21723f79
  Tim Dettmers authored Apr 29, 2023
  
  21723f79
29 Apr, 2023 2 commits
- Added bit template. · cad83994
  Tim Dettmers authored Apr 28, 2023
  
  cad83994
- New implementation for batch size 1. · f3e97ccb
  Tim Dettmers authored Apr 28, 2023
  
  f3e97ccb