- 27 Feb, 2025 1 commit
-
-
Atream authored
-
- 25 Feb, 2025 2 commits
- 22 Feb, 2025 1 commit
-
-
Atream authored
use marlin for lm_head, lm_head only calc last token for prefill extend context window to 19K for DeepSeek-V3/R1 within 24GB VRAM
-
- 19 Feb, 2025 1 commit
-
-
Atream authored
-
- 17 Feb, 2025 1 commit
-
-
Atream authored
-