"vllm/vscode:/vscode.git/clone" did not exist on "b10850444604a901da6cbabd4842a44d190cf35f"
- 08 Jul, 2025 1 commit
-
-
julienmancuso authored
-
- 07 Jul, 2025 10 commits
-
-
mohammedabdulwahhab authored
Signed-off-by:
mohammedabdulwahhab <furkhan324@berkeley.edu> Co-authored-by:
Hannah Zhang <hannahz@nvidia.com> Co-authored-by:
hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
-
jain-ria authored
Signed-off-by:
jain-ria <riajain@NVIDIA.com> Co-authored-by:
Alec <35311602+alec-flowers@users.noreply.github.com>
-
Neelay Shah authored
-
Hongkuan Zhou authored
-
Tanmay Verma authored
-
Anant Sharma authored
-
Anant Sharma authored
-
Jacky authored
-
ishandhanani authored
-
Tanmay Verma authored
-
- 06 Jul, 2025 1 commit
-
-
fsaady authored
Signed-off-by:Fadi Saady <fsaady@nvidia.com>
-
- 04 Jul, 2025 1 commit
-
-
Kristen Kelleher authored
-
- 03 Jul, 2025 10 commits
-
-
Anant Sharma authored
-
Anant Sharma authored
-
Graham King authored
-
Ryan McCormick authored
Co-authored-by:tanmayv25 <tanmay2592@gmail.com>
-
Tom O'Brien authored
-
Neelay Shah authored
Signed-off-by:
Neelay Shah <neelays@nvidia.com> Co-authored-by:
coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
-
Hongkuan Zhou authored
-
ishandhanani authored
-
Anant Sharma authored
Co-authored-by:Kristen Kelleher <kkelleher@nvidia.com>
-
ishandhanani authored
-
- 02 Jul, 2025 4 commits
-
-
ishandhanani authored
-
Indrajit Bhosale authored
-
Meenakshi Sharma authored
Signed-off-by:Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
-
Zhongdongming Dai authored
-
- 01 Jul, 2025 10 commits
-
-
Nathan Barry authored
-
Yan Ru Pei authored
-
sanshang-nv authored
-
ishandhanani authored
-
Alec authored
-
Keiven C authored
Co-authored-by:Keiven Chang <keivenchang@users.noreply.github.com>
-
Paul Hendricks authored
-
Graham King authored
* Added a default temperature value for text generation requests when no temperature is specified. * Improved handling of missing configuration values to prevent errors during model initialization.
-
jthomson04 authored
-
jthomson04 authored
-
- 30 Jun, 2025 3 commits
-
-
GuanLuo authored
Signed-off-by:GuanLuo <41310872+GuanLuo@users.noreply.github.com>
-
Hongkuan Zhou authored
-
Graham King authored
Move much of what was in the `dynamo-run` crate into `dynamo-llm` so that everyone can use it. Example usage: 1. Create a `LocalModel`: ``` let local_model = LocalModelBuilder::default() .model_path("Qwen/Qwen3-0.6B") .http_port(8080) .build().await?; ``` 2. Make an engine: ``` let engine_config = EngineConfig::StaticFull { engine: dynamo_engine_mistralrs::make_engine(&local_model).await?, model: Box::new(local_model), }; ``` 3. Connect it to an input and run it ``` dynamo_llm::entrypoint::input::run_input(Input::Http, runtime, engine_config).await?; ``` For https://github.com/ai-dynamo/dynamo/issues/1647 Code Rabbit summary, thanks: * Introduced a flexible builder pattern for local model configuration, allowing advanced customization and easier initialization. * Added new input modes and unified input handling, supporting interactive chat, HTTP server, batch file, and distributed endpoint modes. * Centralized engine configuration and routing, enabling more extensible and maintainable engine management. * Simplified and modularized the codebase by moving input and engine logic into dedicated modules. * Replaced direct model construction with an asynchronous builder for improved clarity and extensibility. * Streamlined configuration and validation for flags and router settings. * Added validation to prevent incompatible input and output combinations in endpoint and dynamic modes.
-