Commits · eefbf60270497d0dd55b7abe18c519f0c75331f3 · OpenDAS / bitsandbytes

"...text-generation-inference.git" did not exist on "986b4044d17067c8ff851df800f22fa9fb2ace45"

05 Jul, 2023 1 commit
- Added bfloat16 quantizations and tests. · 02fd80cb
  Tim Dettmers authored Jul 04, 2023
  
  02fd80cb
04 Jul, 2023 1 commit
- Initial 4-bit naive batch size 1, 81 vs 185. · f89ff93e
  Tim Dettmers authored Jul 03, 2023
  
  f89ff93e
24 May, 2023 1 commit
- Added PagedLion and bf16 Lion. · 1b8772a8
  Tim Dettmers authored May 23, 2023
  
  1b8772a8
06 May, 2023 1 commit
- Added paging. · ec38ba95
  Tim Dettmers authored May 06, 2023
  
  ec38ba95
01 May, 2023 1 commit
- Slow tensor core solution. · ad07d254
  Tim Dettmers authored Apr 30, 2023
  
  ad07d254
30 Apr, 2023 1 commit
- 4-bit draft. · 21723f79
  Tim Dettmers authored Apr 29, 2023
  
  21723f79
29 Apr, 2023 5 commits
- Added bit template. · cad83994
  Tim Dettmers authored Apr 28, 2023
  
  cad83994
- New implementation for batch size 1. · f3e97ccb
  Tim Dettmers authored Apr 28, 2023
  
  f3e97ccb
- Added fp16 and thread/item template. · f6df4aef
  Tim Dettmers authored Apr 28, 2023
  
  f6df4aef
- Added template refactor. · 3aef7834
  Tim Dettmers authored Apr 28, 2023
  
  3aef7834
- First baseline kernel. · c1bfb210
  Tim Dettmers authored Apr 28, 2023
  
  c1bfb210
27 Apr, 2023 2 commits
- Adedd pipeline draft. · 9cab14a3
  Tim Dettmers authored Apr 27, 2023
  
  9cab14a3
- Best attempt at cutlass3. · 0afc8e9e
  Tim Dettmers authored Apr 26, 2023
  
  0afc8e9e
18 Apr, 2023 1 commit
- Added 32-bit optimizer for bfloat16 gradients. · 7dc198fe
  Tim Dettmers authored Apr 17, 2023
  
  7dc198fe
02 Apr, 2023 1 commit
- First draft of NF4. · 64cc0592
  Tim Dettmers authored Apr 02, 2023
  
  64cc0592
01 Apr, 2023 1 commit
- Added bf16 Adam. · c4cfe4fb
  Tim Dettmers authored Apr 01, 2023
  
  c4cfe4fb
09 Mar, 2023 1 commit
- do a bunch of typical bookkeeping before getting to main lion logic · cb4c3c8c
  Phil Wang authored Mar 09, 2023
  
  cb4c3c8c
14 Feb, 2023 1 commit
- Added more blocksizes for stochastic rounding; fixed dequant blocksize. · 2489d819
  Tim Dettmers authored Feb 14, 2023
  
  2489d819
04 Feb, 2023 1 commit
- Added fp4 quant/dequant and dequant optimizations. · 3ac5840c
  Tim Dettmers authored Feb 04, 2023
  
  3ac5840c
07 Nov, 2022 1 commit
- Added blocksizes 2048, 1024, and 512 to blockwise quant. · 6bc2b992
  Tim Dettmers authored Nov 06, 2022
  
  6bc2b992
27 Oct, 2022 1 commit
- Remove trailing whitespace & ensure newline at EOF · 1eec77d3
  Tom Aarsen authored Oct 27, 2022
  
  1eec77d3
11 Sep, 2022 1 commit
- Fixed 2^31 max size issue for cpu blockwise quant. · 19a7adca
  Tim Dettmers authored Sep 11, 2022
  
  19a7adca
16 Aug, 2022 1 commit
- Removed storage() from get_ptr; added boilerplate for bias dequant_mm. · 1ed2fa2f
  Tim Dettmers authored Aug 16, 2022
  
  1ed2fa2f
26 Jul, 2022 2 commits
- Boilerplate and test for extract_outliers. · cbb901ac
  Tim Dettmers authored Jul 26, 2022
  
  cbb901ac
- Fixed cpuonly build. · 953b7285
  Tim Dettmers authored Jul 26, 2022
  
  953b7285
25 Jul, 2022 1 commit
- Fixed makefile; fixed Ampere igemmlt_8 bug. · 8b1fd32e
  Tim Dettmers authored Jul 25, 2022
  
  8b1fd32e
22 Jul, 2022 1 commit
- Most tests passing. · c771b3a7
  Tim Dettmers authored Jul 22, 2022
  
  c771b3a7
01 Jul, 2022 3 commits
- Reduce diff · 575aa698
  Max Ryabinin authored Jul 01, 2022
  
  575aa698
- Reduce diff · 4d1d5b56
  Max Ryabinin authored Jul 01, 2022
  
  4d1d5b56
- Add a CPU-only build option · 8258b436
  Max Ryabinin authored Jul 01, 2022
  
  8258b436
10 Nov, 2021 1 commit
- Added adagrad with tests (no clipping). · 8b3c0f35
  Tim Dettmers authored Nov 10, 2021
  
  8b3c0f35
21 Oct, 2021 2 commits
- Added skip_zeros; tests are passing. · a6eae2e7
  Tim Dettmers authored Oct 20, 2021
  
  a6eae2e7
- Initial plumbing for skip_zeros. · bb34fd50
  Tim Dettmers authored Oct 20, 2021
  
  bb34fd50
06 Oct, 2021 1 commit
- Initial commit · 74399248
  Tim Dettmers authored Oct 05, 2021
  
  74399248