1. 16 Sep, 2025 1 commit
  2. 22 Aug, 2025 1 commit
  3. 19 Aug, 2025 1 commit
  4. 08 Jul, 2025 1 commit
  5. 15 May, 2025 1 commit
    • Abrar Shivani's avatar
      feat: Use existing Tokio runtime in components (#941) · 2a5eb7e7
      Abrar Shivani authored
      The runtime library already provides a from_current method that creates and returns a Runtime object initialized with the current Tokio runtime handle. Since components do not use the runtime library directly but access it through the worker, the worker needs to be updated to create itself using a Runtime instance derived from the current Tokio runtime.
      This PR updates the http component and the worker to use the existing Tokio runtime instead of creating a new one. Other components can be similarly updated to run using the existing runtime.
      2a5eb7e7
  6. 17 Mar, 2025 1 commit
  7. 13 Mar, 2025 1 commit
    • Graham King's avatar
      feat(dynamo-run): Download models from HF, smart model defaults (#126) · 089f8e1b
      Graham King authored
      
      
      - Any engine can take the name of a Hugging Face repository. It will be downloaded before calling the engine.
      
      - The default engine (previously always mistralrs) depends on what is compiled in.
      
      - Text can be piped in and will result in a single run of the model.
      
      All of those together mean if you build with `--features vllm` you can do this and it will download the model and run it with vllm, answer your question, and exit:
      ```
      echo "What is the capital of Costa Rica?"  | dynamo-run Qwen/Qwen2.5-3B-Instruct
      ```
      Co-authored-by: default avatarRyan McCormick <rmccormick@nvidia.com>
      089f8e1b
  8. 08 Mar, 2025 1 commit
  9. 05 Mar, 2025 1 commit
  10. 25 Feb, 2025 1 commit
  11. 22 Feb, 2025 1 commit
  12. 19 Feb, 2025 1 commit
  13. 18 Feb, 2025 1 commit
  14. 11 Feb, 2025 1 commit
  15. 10 Feb, 2025 1 commit
  16. 05 Feb, 2025 1 commit
  17. 04 Feb, 2025 1 commit