Skip to content

GitLab

Unverified Commit c7821956 authored by Michael McCulloch's avatar Michael McCulloch Committed by GitHub
Browse files

Disable Logs Requests should Disable Logging of requests. (#1779) 


Co-authored-by: default avatarMichael McCulloch <mjm.gitlab@fastmail.com>
parent 0f621c2c
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
vllm/entrypoints/openai/api_server.py
View file @ c7821956
...@@ -207,7 +207,6 @@ async def create_chat_completion(request: ChatCompletionRequest, ...@@ -207,7 +207,6 @@ async def create_chat_completion(request: ChatCompletionRequest,
- function_call (Users should implement this by themselves) - function_call (Users should implement this by themselves)
- logit_bias (to be supported by vLLM engine) - logit_bias (to be supported by vLLM engine)
""" """
logger.info(f"Received chat completion request: {request}")
error_check_ret = await check_model(request) error_check_ret = await check_model(request)
if error_check_ret is not None: if error_check_ret is not None:
...@@ -386,7 +385,6 @@ async def create_completion(request: CompletionRequest, raw_request: Request): ...@@ -386,7 +385,6 @@ async def create_completion(request: CompletionRequest, raw_request: Request):
suffix) suffix)
- logit_bias (to be supported by vLLM engine) - logit_bias (to be supported by vLLM engine)
""" """
logger.info(f"Received completion request: {request}")
error_check_ret = await check_model(request) error_check_ret = await check_model(request)
if error_check_ret is not None: if error_check_ret is not None:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment