Commits · 727172e91ddfd3f5f50efd7cf38a141168186335 · OpenDAS / AutoAWQ

22 Dec, 2023 2 commits
- Fused rope theta (#270) · 727172e9
  Casper authored Dec 23, 2023
```
Co-authored-by: Casper Hansen <casperbh96@gmail.com>
```
  727172e9
- Mixtral: Mixture of Experts quantization (#251) · 5b9f3c47
  Casper authored Dec 22, 2023
  
  5b9f3c47
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
04 Nov, 2023 1 commit
- Create fused LlamaLikeModel (#152) · 8110e028
  Casper authored Nov 04, 2023
  
  8110e028
02 Oct, 2023 1 commit
- Fix Falcon n_kv_heads parameter · 80eea43e
  Casper Hansen authored Oct 02, 2023
  
  80eea43e
21 Sep, 2023 1 commit
- Remove fused modules (later) · 37db5759
  Casper Hansen authored Sep 21, 2023
  
  37db5759
20 Sep, 2023 3 commits
- Add bigcode fused modules (WIP) · b49168f8
  Casper Hansen authored Sep 20, 2023
  
  b49168f8
- Use default attention shapes · d973a0e0
  Casper Hansen authored Sep 20, 2023
  
  d973a0e0
- Support kv_heads · 3256ffec
  Casper Hansen authored Sep 20, 2023
  
  3256ffec
13 Sep, 2023 1 commit
- Set batch size for attention shapes · d3625d1c
  Casper Hansen authored Sep 13, 2023
  
  d3625d1c
12 Sep, 2023 3 commits
- Falcon 40B attention shapes [WIP] · 28d52d81
  Casper Hansen authored Sep 12, 2023
  
  28d52d81
- Create custom attention shape for Falcon 7B · ac770875
  Casper Hansen authored Sep 12, 2023
  
  ac770875
- Create Falcon block and model for fusing · 4517b3f2
  Casper Hansen authored Sep 12, 2023
  
  4517b3f2
11 Sep, 2023 3 commits
- Update MPTBlock, fuse with MPTModel · dd41a223
  Casper Hansen authored Sep 11, 2023
  
  dd41a223
- Initialize with device · e80663bb
  Casper Hansen authored Sep 11, 2023
  
  e80663bb
- Fuse MPT block · 950851b3
  Casper Hansen authored Sep 11, 2023
  
  950851b3