show prompt/s in perf info ⏰

2eaad82a · Danny Liu · 9c3be590 · 2eaad82a
Commit 2eaad82a authored Feb 18, 2024 by Danny Liu
Show whitespace changes
Inline Side-by-side

Showing with 5 additions and 0 deletions

src/lib/components/chat/Messages/ResponseMessage.svelte src/lib/components/chat/Messages/ResponseMessage.svelte +5 -0

No files found.
--- a/src/lib/components/chat/Messages/ResponseMessage.svelte
+++ b/src/lib/components/chat/Messages/ResponseMessage.svelte
@@ -79,6 +79,11 @@
 						) / 100
 					} tokens` ?? 'N/A'
 				}<br/>
+					prompt/s: ${
+						Math.round(
+							((message.info.prompt_eval_count ?? 0) / (message.info.prompt_eval_duration / 1000000000)) * 100
+						) / 100 ?? 'N/A'
+					} prompts<br/>
                    total_duration: ${
 											Math.round(((message.info.total_duration ?? 0) / 1000000) * 100) / 100 ??
 											'N/A'