Commits · 0892d37d2d040bf393ca64cf8fa904f6f0925311 · OpenDAS / ktransformers

18 Apr, 2025 1 commit
- Move KV cache creation to balance_serve · 38e84190
  qiyuxinlin authored Apr 18, 2025
  
  38e84190
31 Mar, 2025 1 commit
- add balance-serve, support concurrence · 25cee581
  Atream authored Mar 31, 2025
  
  25cee581
17 Feb, 2025 1 commit
- fix: fix server for triton kernel · ee24eb8d
  ceerrep authored Feb 17, 2025
  
  ee24eb8d
16 Feb, 2025 1 commit
- feat: add prefix cache for server · bb0ccc7b
  ceerrep authored Feb 17, 2025
  
  bb0ccc7b
04 Nov, 2024 2 commits
- wjh-change · 2d67016d
  anyanqilin authored Oct 29, 2024
  
  2d67016d
- ✨: refactor local_chat and fix message slice bug in server · dd1d8667
  liam authored Oct 21, 2024
  
  dd1d8667
21 Aug, 2024 1 commit
- fix server don't accept yaml path as param; fix server static cache device problem · 170b7a60
  TangJingqi authored Aug 21, 2024
  
  170b7a60
27 Jul, 2024 1 commit
- Initial commit · 18c42e67
  chenxl authored Jul 27, 2024
  
  18c42e67