GitLab

fix chat template encoding

add check-para

change test

kill serve lead to kill sched and engine

update speed test

Update param

Update Function call

优化提示词，解决部分Deepseek r1的兼容性

fix non stream

Fix cmake config error

Move KV cache creation to balance_serve

Signed-off-by: onepick <jiajuku12@163.com>

Enh: Make Ollama perf data more accurate, consistent with OpenAI's implementation

remove hard code max_length

update llama4 tutorial

Fix some build error for ROCM

Signed-off-by: onepick <jiajuku12@163.com>

Modify the performance data calculation module from estimation to retrieving from `raw_usage`.

Feat: Support Non-streaming chat in Ollama backend

Fix the error caused by the client not passing temperature and top_p being empty

1. Fix terrible logic in CMakeLists.txt
2. using the correct typedef for hip
Signed-off-by: onepick <jiajuku12@163.com>

Add bsz_tensors param to torch linear

Update chat.py

Update chat.py

Update chat.py