Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
jerrrrry
infinilm
Commits
3e3c27434f168dc859950c20dcd35f35298a5d25
Switch branch/tag
infinilm
scripts
infer_task.py
25 Jun, 2025
1 commit
refactor task to avoid model dependency on async libs
· 2b9ce5a6
Pan Zezhong
authored
Jun 25, 2025
2b9ce5a6
24 Jun, 2025
1 commit
Support continous batching
· dcd6693f
Pan Zezhong
authored
Jun 24, 2025
dcd6693f
23 Jun, 2025
1 commit
add kv cache pool
· 21f83e91
Pan Zezhong
authored
Jun 23, 2025
21f83e91
