Skip to content

GitLab

Unverified Commit aed54587 authored by Michael Yang's avatar Michael Yang Committed by GitHub
Browse files

Merge pull request #4143 from ollama/mxyng/final-response 

omit prompt and generate settings from final response
parents 52663284 44869c59
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
llm/ext_server/server.cpp
View file @ aed54587
...@@ -1186,8 +1186,6 @@ struct llama_server_context ...@@ -1186,8 +1186,6 @@ struct llama_server_context
{"model", params.model_alias}, {"model", params.model_alias},
{"tokens_predicted", slot.n_decoded}, {"tokens_predicted", slot.n_decoded},
{"tokens_evaluated", slot.n_prompt_tokens}, {"tokens_evaluated", slot.n_prompt_tokens},
{"generation_settings", get_formated_generation(slot)},
{"prompt", slot.prompt},
{"truncated", slot.truncated}, {"truncated", slot.truncated},
{"stopped_eos", slot.stopped_eos}, {"stopped_eos", slot.stopped_eos},
{"stopped_word", slot.stopped_word}, {"stopped_word", slot.stopped_word},
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment