Commits · 4837543a6af294e9e6503852184bf5801cff521a · jerrrrry / infinilm

07 Jul, 2025 1 commit
- issue/14: 修复非流式输出bug · 4fb73db2
  Catheriany authored Jul 07, 2025
  
  4fb73db2
04 Jul, 2025 1 commit
- issue/14: 兼容openai协议 · 9f5e40d6
  Catheriany authored Jul 04, 2025
  
  9f5e40d6
27 Jun, 2025 1 commit
- support max-token and max-batch args · 7a087fdc
  PanZezhong authored Jun 27, 2025
  
  7a087fdc
25 Jun, 2025 2 commits
- refactor task to avoid model dependency on async libs · 2b9ce5a6
  Pan Zezhong authored Jun 25, 2025
  
  2b9ce5a6
- handle client abort · cfc8b598
  Pan Zezhong authored Jun 25, 2025
  
  cfc8b598
24 Jun, 2025 1 commit
- Support continous batching · dcd6693f
  Pan Zezhong authored Jun 24, 2025
  
  dcd6693f
23 Jun, 2025 2 commits
- add kv cache pool · 21f83e91
  Pan Zezhong authored Jun 23, 2025
  
  21f83e91
- change url · a73433ab
  Pan Zezhong authored Jun 23, 2025
  
  a73433ab
20 Jun, 2025 1 commit
- add lock for single request handling, add test server script · 53cb1582
  Pan Zezhong authored Jun 20, 2025
  
  53cb1582
04 Jun, 2025 1 commit
- add server script · 51b1aade
  Pan Zezhong authored Jun 04, 2025
  
  51b1aade