Commits · fcd9637c06034ae5ba9769b09f2e422729f7ce56 · OpenDAS / AutoAWQ

06 Apr, 2024 1 commit
- Workaround: illegal memory access (#421) · f8353793
  Casper authored Apr 06, 2024
  
  f8353793
24 Feb, 2024 1 commit
- New optimized kernels (#365) · 68c727a1
  Casper authored Feb 25, 2024
  
  68c727a1
03 Feb, 2024 1 commit
- AMD ROCM Support (#315) · f018d2b7
  Ilyas Moutawwakil authored Feb 03, 2024
  
  f018d2b7
24 Jan, 2024 1 commit
- Torch only inference + any-device quantization (#319) · c6c7b065
  Casper authored Jan 24, 2024
  
  c6c7b065
21 Jan, 2024 1 commit
- Exllama kernels support (#313) · 2fcbf268
  Ilyas Moutawwakil authored Jan 21, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  2fcbf268
28 Dec, 2023 1 commit
- AWQ: Separate the AWQ kernels to separate repository (#279) · 2edb3f6f
  Casper authored Dec 28, 2023
```
Co-authored-by: Casper Hansen <casperbh96@gmail.com>
```
  2edb3f6f
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
28 Oct, 2023 1 commit
- [`core`] Support fp32 / bf16 inference (#121) · 18712d00
  Younes Belkada authored Oct 28, 2023
  
  18712d00
19 Sep, 2023 1 commit
- Use GEMM v2 kernel for context processing · f3a71d1d
  Casper Hansen authored Sep 19, 2023
  
  f3a71d1d
08 Sep, 2023 2 commits
- Implement GEMM/GEMV in quantize function and fused modules · 5db43a7f
  Casper Hansen authored Sep 08, 2023
  
  5db43a7f
- Refactor modules, create separate GEMM and GEMV · fe314160
  Casper Hansen authored Sep 08, 2023
  
  fe314160