"test/vscode:/vscode.git/clone" did not exist on "bc7db1044a246ab68ece004eeac47efc0fa383f0"
  1. 21 Sep, 2023 1 commit
  2. 13 Sep, 2023 1 commit
  3. 05 Sep, 2023 2 commits
  4. 04 Sep, 2023 1 commit
  5. 26 Aug, 2023 1 commit
  6. 25 Aug, 2023 2 commits
  7. 22 Aug, 2023 1 commit
  8. 11 Aug, 2023 1 commit
  9. 10 Aug, 2023 1 commit
  10. 07 Aug, 2023 3 commits
  11. 06 Aug, 2023 1 commit
  12. 05 Aug, 2023 1 commit
  13. 04 Aug, 2023 4 commits
  14. 03 Aug, 2023 1 commit
  15. 02 Aug, 2023 3 commits
  16. 31 Jul, 2023 1 commit
  17. 28 Jul, 2023 4 commits
  18. 27 Jul, 2023 2 commits
  19. 26 Jul, 2023 1 commit
  20. 24 Jul, 2023 1 commit
    • ZZR0's avatar
      Early stop bug of greedy_until (primary_until should be a list of str) · 984f8793
      ZZR0 authored
      I discovered that the accuracy of all models (e.g., llama7b, llama13b, starcoder) in the 'gsm8k-cot' task was 0%. After a thorough investigation, I realized that the generated text for each question was causing an early stop, preventing the 'regex_pattern' from finding any answers. This issue was caused by an incorrect assignment of the 'primary_until' variable in the 'greedy_until' function. Specifically, 'primary_until' should be a list of strings instead of a single string, as the 'stop_sequences' parameter in the 'stop_sequences_criteria' function requires a List[str]. Once I assigned 'primary_until' to '[until[0]]', the accuracy of llama7b in the 'gsm8k-cot' task increased to 1.67%.
      984f8793
  21. 22 Jul, 2023 1 commit
  22. 21 Jul, 2023 1 commit
  23. 18 Jul, 2023 1 commit
  24. 17 Jul, 2023 1 commit
  25. 16 Jul, 2023 1 commit
  26. 15 Jul, 2023 2 commits