1. 22 Aug, 2025 1 commit
  2. 18 Aug, 2025 1 commit
  3. 11 Aug, 2025 1 commit
  4. 07 Aug, 2025 1 commit
  5. 06 Aug, 2025 2 commits
  6. 31 Jul, 2025 1 commit
  7. 28 Jul, 2025 1 commit
  8. 24 Jul, 2025 1 commit
  9. 18 Jul, 2025 2 commits
  10. 17 Jul, 2025 1 commit
  11. 16 Jul, 2025 1 commit
  12. 14 Jul, 2025 1 commit
  13. 12 Jul, 2025 1 commit
  14. 10 Jul, 2025 2 commits
  15. 08 Jul, 2025 2 commits
  16. 07 Jul, 2025 1 commit
  17. 03 Jul, 2025 1 commit
  18. 30 Jun, 2025 1 commit
    • Graham King's avatar
      chore(dynamo-run): Refactor to library (#1687) · 92f06b0e
      Graham King authored
      Move much of what was in the `dynamo-run` crate into `dynamo-llm` so that everyone can use it.
      
      Example usage:
      
      1. Create a `LocalModel`:
      
      ```
          let local_model = LocalModelBuilder::default()
      	.model_path("Qwen/Qwen3-0.6B")
      	.http_port(8080)
      	.build().await?;
      ```
      
      2. Make an engine:
      
      ```
          let engine_config = EngineConfig::StaticFull {
      	engine: dynamo_engine_mistralrs::make_engine(&local_model).await?,
      	model: Box::new(local_model),
          };
      ```
      
      3. Connect it to an input and run it
      
      ```
          dynamo_llm::entrypoint::input::run_input(Input::Http, runtime, engine_config).await?;
      ```
      
      For https://github.com/ai-dynamo/dynamo/issues/1647
      
      Code Rabbit summary, thanks:
        * Introduced a flexible builder pattern for local model configuration, allowing advanced customization and easier initialization.
        * Added new input modes and unified input handling, supporting interactive chat, HTTP server, batch file, and distributed endpoint modes.
        * Centralized engine configuration and routing, enabling more extensible and maintainable engine management.
        * Simplified and modularized the codebase by moving input and engine logic into dedicated modules.
        * Replaced direct model construction with an asynchronous builder for improved clarity and extensibility.
        * Streamlined configuration and validation for flags and router settings.
        * Added validation to prevent incompatible input and output combinations in endpoint and dynamic modes.
      92f06b0e
  19. 26 Jun, 2025 2 commits
  20. 25 Jun, 2025 4 commits
  21. 17 Jun, 2025 2 commits
  22. 12 Jun, 2025 3 commits
  23. 10 Jun, 2025 1 commit
  24. 04 Jun, 2025 2 commits
  25. 03 Jun, 2025 3 commits
  26. 02 Jun, 2025 1 commit
    • Graham King's avatar
      fix: Allow building only llamacpp or only mistralrs engine. (#1328) · 9907d104
      Graham King authored
      This allows building:
      -  only `mistral.rs` engine: `--no-default-features --features mistralrs`  
      - or only `llama.cpp` engine: `--no-default-features --features llamacpp`. 
      
      Since llama.cpp became a default we'd only tested building both at once. The docs already said we supported that but there was some combo of Rust features that didn't build. This is the fix.
      9907d104