Commits · c6c7b06543bf3a49a9e6a85a41a7fcdcb7d29e4e · OpenDAS / AutoAWQ

24 Jan, 2024 1 commit
- Torch only inference + any-device quantization (#319) · c6c7b065
  Casper authored Jan 24, 2024
  
  c6c7b065
28 Dec, 2023 1 commit
- AWQ: Separate the AWQ kernels to separate repository (#279) · 2edb3f6f
  Casper authored Dec 28, 2023
```
Co-authored-by: Casper Hansen <casperbh96@gmail.com>
```
  2edb3f6f
22 Dec, 2023 1 commit
- Mixtral: Mixture of Experts quantization (#251) · 5b9f3c47
  Casper authored Dec 22, 2023
  
  5b9f3c47
15 Nov, 2023 1 commit
- [`core`] Replace `QuantLlamaMLP` with `QuantFusedMLP` (#188) · 3b362c0d
  Younes Belkada authored Nov 15, 2023
  
  3b362c0d
09 Sep, 2023 1 commit
- Fuse MPT · f3695d60
  Casper Hansen authored Sep 09, 2023
  
  f3695d60
08 Sep, 2023 3 commits
- GEMM + GEMV compatibility · 890b6aa7
  Casper Hansen authored Sep 08, 2023
  
  890b6aa7
- Fix MLP module · 75710806
  Casper Hansen authored Sep 08, 2023
  
  75710806
- Refactor modules, create separate GEMM and GEMV · fe314160
  Casper Hansen authored Sep 08, 2023
  
  fe314160
02 Sep, 2023 2 commits
- Refactor MPT Quant MLP · 1df0136e
  Casper Hansen authored Sep 02, 2023
  
  1df0136e
- Refactor Llama Quant MLP · ded3ea71
  Casper Hansen authored Sep 02, 2023
  
  ded3ea71
27 Aug, 2023 1 commit
- Replace print with logging, Remove uncommented code · b491c2d6
  Casper authored Aug 27, 2023
  
  b491c2d6
24 Aug, 2023 1 commit
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34
24 Jul, 2023 1 commit
- [Major] Add TinyChat and demo. · 4f3e977c
  Haotian Tang authored Jul 23, 2023
  
  4f3e977c