Skip to content

GitLab

Commit 2eaad82a authored by Danny Liu's avatar Danny Liu
Browse files

show prompt/s in perf info ⏰

parent 9c3be590
Show whitespace changes
Inline Side-by-side
Showing with 5 additions and 0 deletions
src/lib/components/chat/Messages/ResponseMessage.svelte
View file @ 2eaad82a
...@@ -79,6 +79,11 @@ ...@@ -79,6 +79,11 @@
) / 100 ) / 100
} tokens` ?? 'N/A' } tokens` ?? 'N/A'
}<br/> }<br/>
prompt/s: ${
Math.round(
((message.info.prompt_eval_count ?? 0) / (message.info.prompt_eval_duration / 1000000000)) * 100
) / 100 ?? 'N/A'
} prompts<br/>
total_duration: ${ total_duration: ${
Math.round(((message.info.total_duration ?? 0) / 1000000) * 100) / 100 ?? Math.round(((message.info.total_duration ?? 0) / 1000000) * 100) / 100 ??
'N/A' 'N/A'
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment