Commits · 5e266532a97f69b799c72a596d0ee4333aaae0c8 · OpenDAS / bitsandbytes

"...text-generation-inference.git" did not exist on "5cddc055e6c0521e4ef11c487fd5f1d9e7ef1e62"

12 Jul, 2023 1 commit
- Added scipy to install_requires · 5e266532
  dulalbert authored Jul 12, 2023
  
  5e266532
20 Jun, 2023 2 commits
- Added scipy to requirements.txt · 237ad492
  dulalbert authored Jun 20, 2023
```
Added scipy to requirements.txt as it is used but not added to requirements
```
  237ad492
- Release 0.39.1. · 4395d68c
  Tim Dettmers authored Jun 19, 2023
  
  4395d68c
19 Jun, 2023 1 commit
- Merge pull request #503 from TimDettmers/efficient_8bit_serialize · 2d321a75
  Tim Dettmers authored Jun 19, 2023
```
Make 8-bit serialization more memory-efficient (v2)
```
  2d321a75
14 Jun, 2023 1 commit
- Only rearrange weight if it exists · b599fdb1
  Max Ryabinin authored Jun 14, 2023
  
  b599fdb1
09 Jun, 2023 3 commits
- Rearrange the weights directly in state dict before loading · c1f3f56d
  Max Ryabinin authored Jun 09, 2023
  
  c1f3f56d
- Improve memory efficiency of 8-bit serialization · f734076e
  Max Ryabinin authored Jun 09, 2023
  
  f734076e
- Extract get_tile_inds to a separate function · 4fb37d45
  Max Ryabinin authored Jun 09, 2023
  
  4fb37d45
31 May, 2023 1 commit
- Added changes for deployment. · ac5550a0
  Tim Dettmers authored May 30, 2023
  
  ac5550a0
24 May, 2023 3 commits
- Bumped version. · 0f40fa3f
  Tim Dettmers authored May 23, 2023
  
  0f40fa3f
- Added PagedLion and bf16 Lion. · 1b8772a8
  Tim Dettmers authored May 23, 2023
  
  1b8772a8
- Fixed Makefile. · 2bce175d
  Tim Dettmers authored May 23, 2023
  
  2bce175d
07 May, 2023 4 commits
- Fixed gradient accumulation test. · 4bd11518
  Tim Dettmers authored May 07, 2023
  
  4bd11518
- Merge remote-tracking branch 'origin/main' into merge · 675baa79
  Tim Dettmers authored May 07, 2023
  
  675baa79
- Fixed prefetch bug for non-paged tensors; added benchmark. · f64cfe65
  Tim Dettmers authored May 06, 2023
  
  f64cfe65
- Changed prefetching. · 41a9c708
  Tim Dettmers authored May 06, 2023
  
  41a9c708
06 May, 2023 2 commits
- Added paged optimizers. · 44d68ff2
  Tim Dettmers authored May 06, 2023
  
  44d68ff2
- Added paging. · ec38ba95
  Tim Dettmers authored May 06, 2023
  
  ec38ba95
02 May, 2023 9 commits
- 4-bit draft; 128 vector load 240. · 264a9485
  Tim Dettmers authored May 02, 2023
  
  264a9485
- Warp multi-specialization 240. · 869b7e83
  Tim Dettmers authored May 02, 2023
  
  869b7e83
- Shared memory efficient 240. · 77f15fdc
  Tim Dettmers authored May 02, 2023
  
  77f15fdc
- A tile multi-tiling. · 89cccd81
  Tim Dettmers authored May 02, 2023
  
  89cccd81
- Removed uncessary sync. · 4decb3cc
  Tim Dettmers authored May 02, 2023
  
  4decb3cc
- Correct implementation 240. · 394749db
  Tim Dettmers authored May 02, 2023
  
  394749db
- Initial. · 9aa232cc
  Tim Dettmers authored May 02, 2023
  
  9aa232cc
- Tighter and scaled error analysis. · 9192c9de
  Tim Dettmers authored May 02, 2023
  
  9192c9de
- Baseline for debugging. · f9bfea8f
  Tim Dettmers authored May 02, 2023
  
  f9bfea8f
01 May, 2023 9 commits
- 8x32 240 6 warps. · 7bfa09d0
  Tim Dettmers authored May 01, 2023
  
  7bfa09d0
- 16x16 240. · 3d4a2ead
  Tim Dettmers authored May 01, 2023
  
  3d4a2ead
- Warp specalization 362. · 7cc8ff47
  Tim Dettmers authored May 01, 2023
  
  7cc8ff47
- Halved shared memory 466. · cabcd9b9
  Tim Dettmers authored Apr 30, 2023
  
  cabcd9b9
- 64 threads, high smem, 434. · 30d03e02
  Tim Dettmers authored Apr 30, 2023
  
  30d03e02
- Fixed bank conflicts in non-vector load 422. · e01d4e03
  Tim Dettmers authored Apr 30, 2023
  
  e01d4e03
- Double frag 440. · c35ed09b
  Tim Dettmers authored Apr 30, 2023
  
  c35ed09b
- Slow non-vector 530. · 604bb3fb
  Tim Dettmers authored Apr 30, 2023
  
  604bb3fb
- Slow tensor core solution. · ad07d254
  Tim Dettmers authored Apr 30, 2023
  
  ad07d254
30 Apr, 2023 1 commit
- 4-bit draft. · 21723f79
  Tim Dettmers authored Apr 29, 2023
  
  21723f79
29 Apr, 2023 3 commits
- Added bit template. · cad83994
  Tim Dettmers authored Apr 28, 2023
  
  cad83994
- New implementation for batch size 1. · f3e97ccb
  Tim Dettmers authored Apr 28, 2023
  
  f3e97ccb
- Added fp16 and thread/item template. · f6df4aef
  Tim Dettmers authored Apr 28, 2023
  
  f6df4aef