- 25 Feb, 2025 3 commits
- 24 Feb, 2025 2 commits
- 23 Feb, 2025 2 commits
-
-
Atream authored
-
DDong Jianwei authored
-
- 22 Feb, 2025 1 commit
-
-
Atream authored
use marlin for lm_head, lm_head only calc last token for prefill extend context window to 19K for DeepSeek-V3/R1 within 24GB VRAM
-
- 21 Feb, 2025 1 commit
-
-
Atream authored
-
- 15 Feb, 2025 1 commit
-
-
Atream authored
-
- 14 Feb, 2025 1 commit
-
-
Azure authored
-
- 13 Feb, 2025 1 commit
-
-
MorphisZhang authored
-
- 12 Feb, 2025 1 commit
-
-
Azure authored
-
- 10 Feb, 2025 1 commit
-
-
liam authored
-
- 07 Feb, 2025 1 commit
-
-
Azure authored
-
- 04 Feb, 2025 2 commits
- 01 Feb, 2025 2 commits
- 31 Jan, 2025 1 commit
-
-
Azure authored
-
- 04 Nov, 2024 1 commit
-
-
anyanqilin authored
-
- 12 Sep, 2024 1 commit
-
-
xhedit authored
-
- 30 Aug, 2024 1 commit
-
-
chenxl authored
-
- 29 Aug, 2024 2 commits
-
-
TangJingqi authored
-
TangJingqi authored
-
- 28 Aug, 2024 1 commit
-
-
chenxl authored
-
- 15 Aug, 2024 3 commits
-
-
TangJingqi authored
-
TangJingqi authored
-
TangJingqi authored
-
- 14 Aug, 2024 1 commit
-
-
Atream authored
[fix] fix ktransformers interface when use new CUDAGraphRunner [fix] fix YAML and optimize logic, the top rule has the highest priority
-
- 12 Aug, 2024 1 commit
-
-
chenxl authored
-
- 08 Aug, 2024 1 commit
-
-
Atream authored
support windows support q4_0 and q5_0 dequant on cpu Add CopyRight from pygguf(It was added before, but disappear after merge). Add some TODO in the code.
-
- 27 Jul, 2024 1 commit
-
-
chenxl authored
-