Commits · c6c7b06543bf3a49a9e6a85a41a7fcdcb7d29e4e · OpenDAS / AutoAWQ

24 Jan, 2024 1 commit
- Torch only inference + any-device quantization (#319) · c6c7b065
  Casper authored Jan 24, 2024
  
  c6c7b065
21 Jan, 2024 1 commit
- Exllama kernels support (#313) · 2fcbf268
  Ilyas Moutawwakil authored Jan 21, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  2fcbf268
28 Dec, 2023 1 commit
- AWQ: Separate the AWQ kernels to separate repository (#279) · 2edb3f6f
  Casper authored Dec 28, 2023
```
Co-authored-by: Casper Hansen <casperbh96@gmail.com>
```
  2edb3f6f
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
28 Oct, 2023 1 commit
- [`core`] Support fp32 / bf16 inference (#121) · 18712d00
  Younes Belkada authored Oct 28, 2023
  
  18712d00
19 Sep, 2023 1 commit
- Use GEMM v2 kernel for context processing · f3a71d1d
  Casper Hansen authored Sep 19, 2023
  
  f3a71d1d
08 Sep, 2023 2 commits
- Implement GEMM/GEMV in quantize function and fused modules · 5db43a7f
  Casper Hansen authored Sep 08, 2023
  
  5db43a7f
- Refactor modules, create separate GEMM and GEMV · fe314160
  Casper Hansen authored Sep 08, 2023
  
  fe314160