huatuogpt-o1

9bce6a82 · mashun1 · 9bce6a82 · 9bce6a82 · 9bce6a82 · 9bce6a82
Commit 9bce6a82 authored Jan 15, 2025 by mashun1
6 changed files
--- a/ppo_utils/ppo_trainer_medo1.py
+++ b/ppo_utils/ppo_trainer_medo1.py
--- a/readme_imgs/alg.png
+++ b/readme_imgs/alg.png
--- a/readme_imgs/arch.png
+++ b/readme_imgs/arch.png
--- a/readme_imgs/result.png
+++ b/readme_imgs/result.png
--- a/requirements.txt
+++ b/requirements.txt
+trl==0.13.0
+accelerate==0.34.2
+# torch==2.5.1
+transformers==4.46.2
+# deepspeed==0.15.4
+# xformers==0.0.28
+# vllm==0.6.4
+# torchvision==0.20.1
+retrying
\ No newline at end of file
--- a/search_for_complex_reasoning_path.py
+++ b/search_for_complex_reasoning_path.py