1. 11 Sep, 2024 1 commit
  2. 02 Aug, 2024 1 commit
  3. 27 Jul, 2024 1 commit
  4. 26 Jul, 2024 2 commits
  5. 22 Jul, 2024 1 commit
  6. 14 Jul, 2024 1 commit
  7. 28 Jun, 2024 1 commit
  8. 25 Jun, 2024 1 commit
    • Blake Mizerany's avatar
      cmd: defer stating model info until necessary (#5248) · 2aa91a93
      Blake Mizerany authored
      This commit changes the 'ollama run' command to defer fetching model
      information until it really needs it. That is, when in interactive mode.
      
      It also removes one such case where the model information is fetch in
      duplicate, just before calling generateInteractive and then again, first
      thing, in generateInteractive.
      
      This positively impacts the performance of the command:
      
          ; time ./before run llama3 'hi'
          Hi! It's nice to meet you. Is there something I can help you with, or would you like to chat?
      
          ./before run llama3 'hi'  0.02s user 0.01s system 2% cpu 1.168 total
          ; time ./before run llama3 'hi'
          Hi! It's nice to meet you. Is there something I can help you with, or would you like to chat?
      
          ./before run llama3 'hi'  0.02s user 0.01s system 2% cpu 1.220 total
          ; time ./before run llama3 'hi'
          Hi! It's nice to meet you. Is there something I can help you with, or would you like to chat?
      
          ./before run llama3 'hi'  0.02s user 0.01s system 2% cpu 1.217 total
          ; time ./after run llama3 'hi'
          Hi! It's nice to meet you. Is there something I can help you with, or would you like to chat?
      
          ./after run llama3 'hi'  0.02s user 0.01s system 4% cpu 0.652 total
          ; time ./after run llama3 'hi'
          Hi! It's nice to meet you. Is there something I can help you with, or would you like to chat?
      
          ./after run llama3 'hi'  0.01s user 0.01s system 5% cpu 0.498 total
          ; time ./after run llama3 'hi'
          Hi! It's nice to meet you. Is there something I can help you with or would you like to chat?
      
          ./after run llama3 'hi'  0.01s user 0.01s system 3% cpu 0.479 total
          ; time ./after run llama3 'hi'
          Hi! It's nice to meet you. Is there something I can help you with, or would you like to chat?
      
          ./after run llama3 'hi'  0.02s user 0.01s system 5% cpu 0.507 total
          ; time ./after run llama3 'hi'
          Hi! It's nice to meet you. Is there something I can help you with, or would you like to chat?
      
          ./after run llama3 'hi'  0.02s user 0.01s system 5% cpu 0.507 total
      2aa91a93
  9. 04 Jun, 2024 1 commit
  10. 24 May, 2024 1 commit
  11. 21 May, 2024 1 commit
  12. 18 May, 2024 1 commit
  13. 14 May, 2024 3 commits
  14. 07 May, 2024 1 commit
  15. 01 May, 2024 1 commit
  16. 23 Apr, 2024 1 commit
  17. 22 Apr, 2024 1 commit
  18. 29 Mar, 2024 1 commit
  19. 26 Mar, 2024 1 commit
  20. 20 Feb, 2024 1 commit
  21. 16 Feb, 2024 1 commit
  22. 12 Feb, 2024 1 commit
  23. 02 Feb, 2024 3 commits
  24. 25 Jan, 2024 1 commit
  25. 12 Jan, 2024 2 commits
  26. 09 Jan, 2024 1 commit
  27. 06 Jan, 2024 1 commit
  28. 05 Jan, 2024 4 commits