Unverified Commit 8820821b authored by AlexZhao's avatar AlexZhao Committed by GitHub
Browse files

[Misc] Fixed the abnormally high TTFT issue in the PD disaggregation example (#18644)


Signed-off-by: default avatarzhaohaidao <zhaohaidao2008@hotmail.com>
Signed-off-by: default avatarzhaohaiyuan <zhaohaiyuan@xiaohongshu.com>
Co-authored-by: default avatarzhaohaiyuan <zhaohaiyuan@xiaohongshu.com>
parent fba06427
......@@ -135,7 +135,7 @@ async def handle_completions(request: Request):
yield chunk
return StreamingResponse(generate_stream(),
media_type="application/json")
media_type="text/event-stream")
except Exception as e:
import sys
......@@ -172,7 +172,7 @@ async def handle_chat_completions(request: Request):
yield chunk
return StreamingResponse(generate_stream(),
media_type="application/json")
media_type="text/event-stream")
except Exception as e:
import sys
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment