Skip to content

GitLab

Commit 781be277 authored by Timothy J. Baek's avatar Timothy J. Baek
Browse files

refac: unnecessary max_token value removed

parent bbeaa929
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 4 deletions
backend/apps/openai/main.py
View file @ 781be277
...@@ -147,13 +147,11 @@ async def proxy(path: str, request: Request, user=Depends(get_verified_user)): ...@@ -147,13 +147,11 @@ async def proxy(path: str, request: Request, user=Depends(get_verified_user)):
print("Modified body_dict:", body) print("Modified body_dict:", body)
# Fix for ChatGPT calls failing because the num_ctx key is in body # Fix for ChatGPT calls failing because the num_ctx key is in body
if 'num_ctx' in body: if "num_ctx" in body:
# If 'num_ctx' is in the dictionary, delete it # If 'num_ctx' is in the dictionary, delete it
# Leaving it there generates an error with the # Leaving it there generates an error with the
# OpenAI API (Feb 2024) # OpenAI API (Feb 2024)
del body['num_ctx'] del body["num_ctx"]
# OpenAI API (Feb 2024) accepts max_tokens
body["max_tokens"] = 1600
# Convert the modified body back to JSON # Convert the modified body back to JSON
body = json.dumps(body) body = json.dumps(body)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment