Merge pull request #4143 from ollama/mxyng/final-response

omit prompt and generate settings from final response

Merge pull request #4143 from ollama/mxyng/final-response
omit prompt and generate settings from final response
aed54587 · Michael Yang · GitHub · 52663284 · 44869c59 · aed54587
Unverified Commit aed54587 authored May 03, 2024 by Michael Yang Committed by GitHub May 03, 2024
Hide whitespace changes
Inline Side-by-side

Showing with 0 additions and 2 deletions

llm/ext_server/server.cpp llm/ext_server/server.cpp +0 -2

No files found.
--- a/llm/ext_server/server.cpp
+++ b/llm/ext_server/server.cpp
@@ -1186,8 +1186,6 @@ struct llama_server_context
            {"model",               params.model_alias},
            {"tokens_predicted",    slot.n_decoded},
            {"tokens_evaluated",    slot.n_prompt_tokens},
-            {"generation_settings", get_formated_generation(slot)},
-            {"prompt",              slot.prompt},
            {"truncated",           slot.truncated},
            {"stopped_eos",         slot.stopped_eos},
            {"stopped_word",        slot.stopped_word},