Commits · 7dca70049566b5b1c55cbd67e1cb191729a98152 · OpenDAS / bitsandbytes

20 Sep, 2024 1 commit

Add AdEMAMix optimizer (#1360) · d9645465

Matthew Douglas authored Sep 20, 2024

* Add AdEMAMix optimizer

* Add PagedAdEMAMix32bit, AdEMAMix32bit

* Add PagedAdEMAMix32bit, AdEMAMix32bit

* AdEMAMix: add support for alpha/beta3 scheduling

* Update paged AdEMAMix

d9645465

26 Aug, 2024 1 commit

Cuda source cleanup , refactor and fixes (#1328) · 6bef412a

Abhilash Majumder authored Aug 26, 2024

* remove kcompress

* fix initial template call

* fix function name

* remove vector load

* cleanup reduce  & rearrange

* format

6bef412a

10 Jul, 2023 1 commit
- Added fp32 compute type for gemv_4bit. · 5fab6734
  Tim Dettmers authored Jul 09, 2023
  
  5fab6734
09 Jul, 2023 1 commit
- Added abitrary data types; fixed a bug for small matrices. · 4b88d69d
  Tim Dettmers authored Jul 09, 2023
  
  4b88d69d
04 Jul, 2023 1 commit
- Initial 4-bit naive batch size 1, 81 vs 185. · f89ff93e
  Tim Dettmers authored Jul 03, 2023
  
  f89ff93e
06 May, 2023 1 commit
- Added paging. · ec38ba95
  Tim Dettmers authored May 06, 2023
  
  ec38ba95
30 Apr, 2023 1 commit
- 4-bit draft. · 21723f79
  Tim Dettmers authored Apr 29, 2023
  
  21723f79
29 Apr, 2023 5 commits
- Added bit template. · cad83994
  Tim Dettmers authored Apr 28, 2023
  
  cad83994
- New implementation for batch size 1. · f3e97ccb
  Tim Dettmers authored Apr 28, 2023
  
  f3e97ccb
- Added fp16 and thread/item template. · f6df4aef
  Tim Dettmers authored Apr 28, 2023
  
  f6df4aef
- Added template refactor. · 3aef7834
  Tim Dettmers authored Apr 28, 2023
  
  3aef7834
- First baseline kernel. · c1bfb210
  Tim Dettmers authored Apr 28, 2023
  
  c1bfb210
27 Apr, 2023 2 commits
- Adedd pipeline draft. · 9cab14a3
  Tim Dettmers authored Apr 27, 2023
  
  9cab14a3
- Best attempt at cutlass3. · 0afc8e9e
  Tim Dettmers authored Apr 26, 2023
  
  0afc8e9e
25 Apr, 2023 1 commit
- Initial template. · 6bfd7a40
  Tim Dettmers authored Apr 25, 2023
  
  6bfd7a40
02 Apr, 2023 1 commit
- First draft of NF4. · 64cc0592
  Tim Dettmers authored Apr 02, 2023
  
  64cc0592
10 Mar, 2023 1 commit
- always pass beta2 into all the 1state functions · 6c377b39
  Phil Wang authored Mar 10, 2023
  
  6c377b39
04 Feb, 2023 1 commit
- Added fp4 quant/dequant and dequant optimizations. · 3ac5840c
  Tim Dettmers authored Feb 04, 2023
  
  3ac5840c
08 Nov, 2022 1 commit
- Fixed bug in cpu quant; faster GPU dequant. · 08fa2e7b
  Tim Dettmers authored Nov 07, 2022
  
  08fa2e7b
27 Oct, 2022 1 commit
- Remove trailing whitespace & ensure newline at EOF · 1eec77d3
  Tom Aarsen authored Oct 27, 2022
  
  1eec77d3
16 Aug, 2022 1 commit
- Removed storage() from get_ptr; added boilerplate for bias dequant_mm. · 1ed2fa2f
  Tim Dettmers authored Aug 16, 2022
  
  1ed2fa2f
27 Jul, 2022 1 commit
- Working outlier extraction for Turing. · bcab99ec
  Tim Dettmers authored Jul 26, 2022
  
  bcab99ec
26 Jul, 2022 2 commits
- Boilerplate and test for extract_outliers. · cbb901ac
  Tim Dettmers authored Jul 26, 2022
  
  cbb901ac
- Some progress on build script; added multi-cuda install script. · 9268dc9d
  Tim Dettmers authored Jul 25, 2022
  
  9268dc9d
22 Jul, 2022 1 commit
- Most tests passing. · c771b3a7
  Tim Dettmers authored Jul 22, 2022
  
  c771b3a7
21 Oct, 2021 1 commit
- Initial plumbing for skip_zeros. · bb34fd50
  Tim Dettmers authored Oct 20, 2021
  
  bb34fd50
06 Oct, 2021 1 commit
- Initial commit · 74399248
  Tim Dettmers authored Oct 05, 2021
  
  74399248