Commits · a41d2163933a55ea34ea517454b1d27f7a052037 · wqshmzh / ktransformers

31 Mar, 2025 1 commit
- add balance-serve, support concurrence · 25cee581
  Atream authored Mar 31, 2025
  
  25cee581
01 Mar, 2025 1 commit
- support chunk prefill, support 139K context for 24G VRAM · f35e8d41
  Atream authored Mar 01, 2025
  
  f35e8d41
25 Feb, 2025 1 commit
- feat: basic api key support · f639fbc1
  ceerrep authored Feb 25, 2025
  
  f639fbc1
16 Feb, 2025 1 commit
- feat: add prefix cache for server · bb0ccc7b
  ceerrep authored Feb 17, 2025
  
  bb0ccc7b
12 Feb, 2025 3 commits
- ⚡ support force thinking · 4385e850
  liam authored Feb 12, 2025
  
  4385e850
- ⚡ update force_think config · 6f3a39be
  liam authored Feb 12, 2025
  
  6f3a39be
- ⚡ update force_think · e536e142
  liam authored Feb 12, 2025
  
  e536e142
14 Nov, 2024 1 commit
- ⚡ rm opt config path default value and fix some config logic bug · 04cebec4
  liam authored Nov 14, 2024
  
  04cebec4
04 Nov, 2024 4 commits
- ✨: rm sensitive info in config.yaml, add readme of makefile. support old model_path config · a148da2c
  liam authored Oct 31, 2024
  
  a148da2c
- wjh fix change · 9a2e7057
  anyanqilin authored Oct 30, 2024
  
  9a2e7057
- wjh-change · 2d67016d
  anyanqilin authored Oct 29, 2024
  
  2d67016d
- ✨: refactor local_chat and fix message slice bug in server · dd1d8667
  liam authored Oct 21, 2024
  
  dd1d8667