- 18 Dec, 2025 1 commit
-
-
jthomson04 authored
Signed-off-by:jthomson04 <jwillthomson19@gmail.com>
-
- 16 Sep, 2025 1 commit
-
-
Graham King authored
Signed-off-by:Graham King <grahamk@nvidia.com>
-
- 22 Aug, 2025 1 commit
-
-
Graham King authored
-
- 19 Aug, 2025 1 commit
-
-
Ryan Olson authored
Signed-off-by:
Ryan Olson <rolson@nvidia.com> Co-authored-by:
Olga Andreeva <oandreeva@nvidia.com> Co-authored-by:
Ziqi Fan <ziqif@nvidia.com> Co-authored-by:
John Thompson <jothomson@nvidia.com> Co-authored-by:
Richard Huo <rihuo@nvidia.com> Co-authored-by:
Zicheng Ma <zichengm@nvidia.com>
-
- 30 Jun, 2025 1 commit
-
-
Graham King authored
Move much of what was in the `dynamo-run` crate into `dynamo-llm` so that everyone can use it. Example usage: 1. Create a `LocalModel`: ``` let local_model = LocalModelBuilder::default() .model_path("Qwen/Qwen3-0.6B") .http_port(8080) .build().await?; ``` 2. Make an engine: ``` let engine_config = EngineConfig::StaticFull { engine: dynamo_engine_mistralrs::make_engine(&local_model).await?, model: Box::new(local_model), }; ``` 3. Connect it to an input and run it ``` dynamo_llm::entrypoint::input::run_input(Input::Http, runtime, engine_config).await?; ``` For https://github.com/ai-dynamo/dynamo/issues/1647 Code Rabbit summary, thanks: * Introduced a flexible builder pattern for local model configuration, allowing advanced customization and easier initialization. * Added new input modes and unified input handling, supporting interactive chat, HTTP server, batch file, and distributed endpoint modes. * Centralized engine configuration and routing, enabling more extensible and maintainable engine management. * Simplified and modularized the codebase by moving input and engine logic into dedicated modules. * Replaced direct model construction with an asynchronous builder for improved clarity and extensibility. * Streamlined configuration and validation for flags and router settings. * Added validation to prevent incompatible input and output combinations in endpoint and dynamic modes.
-
- 24 Jun, 2025 1 commit
-
-
Tianer Zhou authored
Signed-off-by:
Tianer Zhou <ezhoureal@gmail.com> Co-authored-by:
Yan Ru Pei <yanrpei@gmail.com>
-
- 09 Jun, 2025 2 commits
-
-
jthomson04 authored
-
jthomson04 authored
-
- 29 May, 2025 1 commit
-
-
jthomson04 authored
-
- 24 May, 2025 1 commit
-
-
jthomson04 authored
-
- 22 May, 2025 1 commit
-
-
jthomson04 authored
-
- 20 May, 2025 1 commit
-
-
Ryan Olson authored
-
- 19 May, 2025 1 commit
-
-
Jacky authored
-
- 14 May, 2025 1 commit
-
-
jthomson04 authored
-
- 09 May, 2025 1 commit
-
-
Ryan Olson authored
-