Merge pull request #1289 from kvcache-ai/update-default-config

update default config

Merge pull request #1289 from kvcache-ai/update-default-config
update default config
02948bc1 · wang jiahao · GitHub · 84562228 · 69744490 · 02948bc1
Unverified Commit 02948bc1 authored May 13, 2025 by wang jiahao Committed by GitHub May 13, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

ktransformers/configs/config.yaml ktransformers/configs/config.yaml +1 -1

No files found.
--- a/ktransformers/configs/config.yaml
+++ b/ktransformers/configs/config.yaml
@@ -29,7 +29,7 @@ model:
  gguf_path: ./DeepSeek-V2-Lite-Chat-GGUF

  device: cuda:0
-  cache_lens: 8192
+  cache_lens: 16384
  max_new_tokens: 500
 web:
  mount: False