Update Dockerfile

a649dc80 · Timothy J. Baek · 733d6942 · a649dc80
Commit a649dc80 authored Apr 08, 2024 by Timothy J. Baek
Show whitespace changes
Inline Side-by-side

Showing with 32 additions and 27 deletions

Dockerfile Dockerfile +32 -27

No files found.
--- a/Dockerfile
+++ b/Dockerfile
@@ -50,6 +50,11 @@ ENV OPENAI_API_KEY="" \
    SCARF_NO_ANALYTICS=true \
    DO_NOT_TRACK=true

+# Use locally bundled version of the LiteLLM cost map json
+# to avoid repetitive startup connections
+ENV LITELLM_LOCAL_MODEL_COST_MAP="True"
+
+
 #### Other models #########################################################
 ## whisper TTS model settings ##
 ENV WHISPER_MODEL="base" \