Commits · 5b9f3c47c68a3aa632196a9d909290d0b8d26add · OpenDAS / AutoAWQ

22 Dec, 2023 1 commit
- Mixtral: Mixture of Experts quantization (#251) · 5b9f3c47
  Casper authored Dec 22, 2023
  
  5b9f3c47
03 Dec, 2023 1 commit
- Fix position ids (#215) · 4d49ae1f
  Casper authored Dec 03, 2023
  
  4d49ae1f
28 Nov, 2023 1 commit
- New scaling to improve perplexity (#216) · d1112e1c
  Casper authored Nov 28, 2023
  
  d1112e1c
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
11 Nov, 2023 2 commits
- Fix cache util logic (#186) · 299c460b
  Casper authored Nov 11, 2023
  
  299c460b
- Reset cache on new generation (#178) · df909e83
  Casper authored Nov 11, 2023
  
  df909e83
04 Nov, 2023 1 commit
- Create fused LlamaLikeModel (#152) · 8110e028
  Casper authored Nov 04, 2023
  
  8110e028
06 Oct, 2023 1 commit
- Move attention shapes to fused_utils · 306de683
  Casper Hansen authored Oct 06, 2023
  
  306de683
26 Sep, 2023 1 commit
- Add compute_memory_used_pct function · 3bb4a9f6
  Casper Hansen authored Sep 26, 2023
  
  3bb4a9f6
20 Sep, 2023 1 commit
- Initial quantization refactoring · 45c22ee5
  Casper authored Sep 20, 2023
  
  45c22ee5
15 Sep, 2023 1 commit
- Move shuffling up for datasets loaded with load_dataset · d832a218
  Casper authored Sep 15, 2023
  
  d832a218
14 Sep, 2023 1 commit
- Allow huggingface datasets · faedf517
  Casper authored Sep 14, 2023
  
  faedf517
05 Sep, 2023 1 commit
- allow user to use custom calibration data for quantization · 1712ce21
  Erwan BOEHM authored Sep 05, 2023
  
  1712ce21
02 Sep, 2023 1 commit
- Refactor Llama quant attention · 2082197d
  Casper Hansen authored Sep 02, 2023
  
  2082197d
27 Aug, 2023 1 commit
- Replace print with logging, Remove uncommented code · b491c2d6
  Casper authored Aug 27, 2023
  
  b491c2d6
21 Aug, 2023 1 commit
- [Minor] Temporarily change calibration dataset URL · 9c1ab9ba
  Jiaming Tang authored Aug 21, 2023
  
  9c1ab9ba
18 Aug, 2023 1 commit
- Implement fallback calibration dataset (wikitext). · af4e0622
  Casper Hansen authored Aug 18, 2023
  
  af4e0622
17 Aug, 2023 2 commits
- Implement argparse and perplexity · 934ad336
  Casper Hansen authored Aug 17, 2023
  
  934ad336
- Refactored pre_quant into base · 290f45e7
  Casper Hansen authored Aug 17, 2023
  
  290f45e7
19 Jul, 2023 1 commit
- Memory optimization · ba01560f
  Abhinav Kulkarni authored Jul 11, 2023
  
  ba01560f
25 Jun, 2023 1 commit
- [Major] Add support for BLOOM, MPT and Falcon. · 71d8e68d
  Haotian Tang authored Jun 25, 2023
  
  71d8e68d
01 Jun, 2023 1 commit
- first commit · 460d6d45
  Ji Lin authored May 31, 2023
  
  460d6d45