Commits · c5f036e8a4ab2a2ce7e18bb89a8ffdf1bfa5e337 · OpenDAS / ktransformers

15 Feb, 2025 2 commits
- toy support for experts on GPU, no CUDA Graph · c189d55b
  Atream authored Feb 15, 2025
  
  c189d55b
- get dirname if gguf_path is a file · 22280bf1
  Shuaiyi authored Feb 14, 2025
  
  22280bf1
02 Sep, 2024 1 commit
- Support IQ4_XS dequantize · be356c1b
  Yap Sok Ann authored Sep 02, 2024
  
  be356c1b
28 Aug, 2024 1 commit
- [feature] release 0.1.3 · 4d1d561d
  chenxl authored Aug 28, 2024
  
  4d1d561d
22 Aug, 2024 1 commit
- [fix] f16 dequantize device ignored · 29f4151e
  molamooo authored Aug 22, 2024
  
  29f4151e
12 Aug, 2024 2 commits
- [feature] support q2_k & q3_k dequantize on gpu · 7c4cb520
  BITcyman authored Aug 12, 2024
  
  7c4cb520
- [ADD] support multi-gpu qlen>1 q5_k · f5f79f5c
  chenxl authored Aug 12, 2024
  
  f5f79f5c
08 Aug, 2024 2 commits
- [fix] recover fp16 support · 0e613b60
  Atream authored Aug 08, 2024
  
  0e613b60
- support windows support q4_0 and q5_0 dequant on cpu Add CopyRight from... · 0a2fd52c
  Atream authored Aug 07, 2024
```
support windows support q4_0 and q5_0 dequant on cpu Add CopyRight from pygguf(It was added before, but disappear after merge). Add some TODO in the code.
```
  0a2fd52c
27 Jul, 2024 1 commit
- Initial commit · 18c42e67
  chenxl authored Jul 27, 2024
  
  18c42e67