add o3-mini support (#2697)

* add o3-mini support * fix linter tests

add o3-mini support (#2697)
* add o3-mini support * fix linter tests
01849b40 · Jocelyn · GitHub · a9a0e3ca · 01849b40
Unverified Commit 01849b40 authored Feb 25, 2025 by Jocelyn Committed by GitHub Feb 25, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

lm_eval/models/openai_completions.py lm_eval/models/openai_completions.py +2 -0

No files found.
--- a/lm_eval/models/openai_completions.py
+++ b/lm_eval/models/openai_completions.py
@@ -291,4 +291,6 @@ class OpenAIChatCompletion(LocalChatCompletion):
        if "o1" in self.model:
            output.pop("stop")
            output["temperature"] = 1
+        elif "o3" in self.model:
+            output.pop("temperature")
        return output