Commits · 4870580f17767a4165ec05d954dff2b5c25b694d · OpenDAS / bitsandbytes

08 Jan, 2024 1 commit
- Fixed bnb input in setup.py. Bumped version for release. · 4870580f
  Tim Dettmers authored Jan 07, 2024
  
  4870580f
10 Nov, 2023 2 commits
- extra check for qs_dict['shape'] is None · 079d7afe
  Ruslan Svirschevski authored Nov 10, 2023
  
  079d7afe
- unshared nested_quant_map · de44be1a
  Ruslan Svirschevski authored Nov 10, 2023
  
  de44be1a
09 Nov, 2023 1 commit
- fixes for init and tests · ffd46ce1
  Ruslan Svirschevski authored Nov 10, 2023
  
  ffd46ce1
08 Nov, 2023 4 commits
- remove moving offset if not nested · 74c00eb1
  Ruslan Svirschevski authored Nov 09, 2023
  
  74c00eb1
- partially reverted 76b40a5c · 781fcd5b
  Ruslan Svirschevski authored Nov 08, 2023
  
  781fcd5b
- cleanup 0 · c6d0a847
  Ruslan Svirschevski authored Nov 08, 2023
  
  c6d0a847
- Update functional.py · 67adb47b
  Younes Belkada authored Nov 08, 2023
  
  67adb47b
02 Nov, 2023 10 commits
- renamed code to `quant_map` in serialized QState · 851806e0
  Ruslan Svirschevski authored Nov 02, 2023
  
  851806e0
- save/load via state_dict now · 76b40a5c
  Ruslan Svirschevski authored Oct 25, 2023
  
  76b40a5c
- reverted fn signatures in functional() · 4c11d6dc
  Ruslan Svirschevski authored Sep 20, 2023
  
  4c11d6dc
- add QuantState.__get_item__() for compatibility · 1d9f0f2a
  Ruslan Svirschevski authored Sep 20, 2023
  
  1d9f0f2a
- cleanup1 · 7a117e44
  Ruslan Svirschevski authored Sep 13, 2023
  
  7a117e44
- rework of non-tensor qs items storage · 6cf0f05d
  Ruslan Svirschevski authored Sep 13, 2023
  
  6cf0f05d
- [WiP] rework of Q_state save format · 1d541b50
  Ruslan Svirschevski authored Sep 13, 2023
  
  1d541b50
- some renaming · 48b3e770
  Ruslan Svirschevski authored Sep 12, 2023
  
  48b3e770
- save/load 4bit squashed · 5bcc1ddc
  Ruslan Svirschevski authored Sep 11, 2023
  
  5bcc1ddc
- use QuantState class for quant_state · 61a4a20d
  Ruslan Svirschevski authored Sep 11, 2023
  
  61a4a20d
04 Aug, 2023 1 commit
- Fixed two bugs in dynamic data type creation. · 3c9aca91
  Tim Dettmers authored Aug 03, 2023
  
  3c9aca91
14 Jul, 2023 3 commits
- Fixed a bug in absmax float conversion. · c00402f1
  Tim Dettmers authored Jul 13, 2023
  
  c00402f1
- Added documentation for NF4; failing 8-bit matmul; fixed absmax bug. #529 #543 · 67475257
  Tim Dettmers authored Jul 13, 2023
  
  67475257
- Fixed bug caused by undefined default type of absmax. #553 · 097b1cc5
  Tim Dettmers authored Jul 13, 2023
  
  097b1cc5
12 Jul, 2023 1 commit
- Fixed missing bias in bnb.matmul_4bit for inference; more tests. · 90b0ac57
  Tim Dettmers authored Jul 11, 2023
  
  90b0ac57
11 Jul, 2023 1 commit
- Added more extensive gemv tests; blocksize guard for gemv. · ba51d95d
  Tim Dettmers authored Jul 11, 2023
  
  ba51d95d
10 Jul, 2023 2 commits
- Added fp32 compute type for gemv_4bit. · 5fab6734
  Tim Dettmers authored Jul 09, 2023
  
  5fab6734
- Added test for Param4bit.to() and fixed double quant behavior. · cef519c8
  Tim Dettmers authored Jul 09, 2023
  
  cef519c8
09 Jul, 2023 4 commits
- Fixed a bug where gemv_4bit would return a wrongly sized tensor. · 6a905be5
  Tim Dettmers authored Jul 09, 2023
  
  6a905be5
- Added double quantization support and tests. · 0f0390ac
  Tim Dettmers authored Jul 09, 2023
  
  0f0390ac
- Added FP4 fast inference support. · 94168d79
  Tim Dettmers authored Jul 09, 2023
  
  94168d79
- Added abitrary data types; fixed a bug for small matrices. · 4b88d69d
  Tim Dettmers authored Jul 09, 2023
  
  4b88d69d
05 Jul, 2023 1 commit
- Added bfloat16 quantizations and tests. · 02fd80cb
  Tim Dettmers authored Jul 04, 2023
  
  02fd80cb
04 Jul, 2023 1 commit
- Initial 4-bit naive batch size 1, 81 vs 185. · f89ff93e
  Tim Dettmers authored Jul 03, 2023
  
  f89ff93e
24 May, 2023 2 commits
- Added PagedLion and bf16 Lion. · 1b8772a8
  Tim Dettmers authored May 23, 2023
  
  1b8772a8
- Fixed Makefile. · 2bce175d
  Tim Dettmers authored May 23, 2023
  
  2bce175d
07 May, 2023 1 commit
- Changed prefetching. · 41a9c708
  Tim Dettmers authored May 06, 2023
  
  41a9c708
06 May, 2023 2 commits
- Added paged optimizers. · 44d68ff2
  Tim Dettmers authored May 06, 2023
  
  44d68ff2
- Added paging. · ec38ba95
  Tim Dettmers authored May 06, 2023
  
  ec38ba95
02 May, 2023 2 commits
- 4-bit draft; 128 vector load 240. · 264a9485
  Tim Dettmers authored May 02, 2023
  
  264a9485
- Baseline for debugging. · f9bfea8f
  Tim Dettmers authored May 02, 2023
  
  f9bfea8f
30 Apr, 2023 1 commit
- 4-bit draft. · 21723f79
  Tim Dettmers authored Apr 29, 2023
  
  21723f79