GitLab

Support for IQ1_S(Dynamic 1.58-bit)

fix typo for top_p

fix ollama api temperature bug

Update:Solve  `torch.backends.cuda.sdp_kernel()` is deprecated.

Update local_chat.py

修复config.architectures[0] == "DeepseekV2ForCausalLM" or "DeepseekV3ForCausalLM" 永远为真

Update DeepseekR1_V3_tutorial.md

Support chunk prefill. Support 139K context for DeepSeek-R1 139K with in 24G VRAM.

fix cache_lens bug in server and rm test prompt.txt

Delete duplicate code

⚡ fox docker build

[fix] Fix template name

[UPDATE] Update ZH/EN issue template

fix temperature

use generation config from json file in official repo

Allow temperature and top_p from /v1/chat/completions