Commits · d83854b517a58a40e03857ed5bc0cf2b4a9c02c3 · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "5139f688cb2697d652d6bdac996fefb2a05d7f70"

02 Sep, 2025 6 commits
- refactor: Rewrite test_metrics_labels to use TRTLLMProcess. (#2794) · d83854b5
  Tzu-Ling Kan authored Sep 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d83854b5
- chore: add pydantic validation for benchmark profile config (#2791) · 882ae1b4
  Michael Shin authored Sep 02, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  882ae1b4
- fix: port forward to available ports when benchmarking (#2795) · 5bbbeae3
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  5bbbeae3
- feat: added support for pythonic tool parser (#2788) · d39d676b
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d39d676b
- feat: Add support for model express url injection (#2769) · 58d2699d
  julienmancuso authored Sep 02, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  58d2699d
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 5 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- fix: fix #2653: links of h100_prefill_performance.png and h100_decode_performance.png (#2650) · 3f09c395
  Jason Zhou authored Aug 30, 2025
  
  3f09c395
- feat: DIS-373 dynamo KVBM connector API integration with TRTLLM (#2544) · a68c2f8f
  Richard Huo authored Aug 29, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  a68c2f8f
- feat: add logits processor support for trtllm backend (#2702) · 43a26958
  Bhuvan Agrawal authored Aug 29, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  43a26958
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
29 Aug, 2025 15 commits
- fix: add dev tools to devcontainer (#2777) · 3c4adde5
  Alec authored Aug 29, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  3c4adde5
- chore: rm not needed kvbm Dockerfile (#2789) · b738e6a0
  Ziqi Fan authored Aug 29, 2025
  
  b738e6a0
- chore: add more reasoning and tool call parsers explicitly, remove unecessary files (#2785) · 295964e3
  nachiketb-nvidia authored Aug 29, 2025
```
Signed-off-by: nachiketb <nachiketb@nvidia.com>
```
  295964e3
- ci: Skip gitlab job on docs-only changes, only run rust jobs on rust changes (#2775) · a1ca39a9
  Ryan McCormick authored Aug 29, 2025
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
```
  a1ca39a9
- fix: Remove duplicate import and update the test comment. (#2784) · ea7a9236
  Tzu-Ling Kan authored Aug 29, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  ea7a9236
- chore: added include_stop_str_in_output (#2782) · 1f6b83be
  Ayush Agarwal authored Aug 29, 2025
  
  1f6b83be
- fix: update concurrency to not cancel main runs (#2780) · bb9566b7
  Anant Sharma authored Aug 29, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  bb9566b7
- test: add tests for replica calculation and planner scaling (#2525) · 353ba5db
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  353ba5db
- feat: Add Encode Worker and NIXL support to trtllm multimodal flow (#2452) · 781fa062
  Indrajit Bhosale authored Aug 29, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  781fa062
- fix: fix Lychee (#2779) · 17861703
  julienmancuso authored Aug 29, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  17861703
- feat: add Prometheus metrics integration for KvStats (#2704) · 15539fd0
  Keiven C authored Aug 28, 2025
```
Signed-off-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  15539fd0
- feat: update planner to use DYN_PARENT_DGD_K8S_NAME (#2774) · 37adc0a8
  julienmancuso authored Aug 28, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  37adc0a8
- feat: Add Grove and Kai scheduler as part of dynamo cloud helm chart (#2755) · e28ff8d2
  julienmancuso authored Aug 28, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  e28ff8d2
- fix: [trtllm] add wait_for_instance before register_llm (#2683) · 8c2072cf
  Alec authored Aug 28, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  8c2072cf
- chore: deprecate nvext.top_k and nvext.repetition_penalty and make available top level (#2767) · 63f5bbc0
  ryan-lempka authored Aug 28, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  63f5bbc0
28 Aug, 2025 13 commits
- docs: Fix dynamo cloud quickstart links (#2765) · 79a9d69d
  Ryan McCormick authored Aug 28, 2025
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
```
  79a9d69d
- docs: Use GFM Admonition style (#2771) · ea0c0027
  Neal Vaidya authored Aug 28, 2025
```
Increases prominence of admonition in GitHub and still works correctly in sphinx thanks to ./docs/_extensions/github_alerts.py
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  ea0c0027
- feat: Prevent double-tokenization when EPP picks worker (#2559) · 7d13b6e3
  atchernych authored Aug 28, 2025
  
  7d13b6e3
- feat: Integrate Model Express Client into Dynamo Model Downloads (#2574) · 95ce83d5
  KavinKrishnan authored Aug 28, 2025
```
Signed-off-by: Kavin Krishnan <kavink@nvidia.com>
Co-authored-by: KavinKrishnan <kavin.krishnan@nvidia.com>
```
  95ce83d5
- feat: add SGLANG devcontainer documentation (#2741) · 9c4e9950
  Keiven C authored Aug 28, 2025
```
Co-authored-by: Ubuntu <ubuntu@keivenc-linux.nvidia.com>
```
  9c4e9950
- fix: Added description to async-openai/Cargo.toml (#2761) · fee976a2
  Dmitry Tokarev authored Aug 28, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fee976a2
- docs: add mermaid graph to .devcontainer/README.md, remove mount (revert). (#2632) · 357aa69e
  Keiven C authored Aug 28, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  357aa69e
- refactor: centralize Prometheus metrics naming and sanitization DIS-554 (#2733) · 84c9890b
  Keiven C authored Aug 28, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  84c9890b
- ci: add support for vllm sanity testing on Github (#2526) · 82bae247
  Anant Sharma authored Aug 28, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  82bae247
- chore: deprecate duplicate params in nvext (#2754) · e3619ce0
  ryan-lempka authored Aug 27, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  e3619ce0
- feat: Add vLLM multimodal video support (#2738) · 78a11074
  Kris Hung authored Aug 27, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  78a11074
- chore: Update support_matrix.md (#2735) · 46175f5d
  Dmitry Tokarev authored Aug 27, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  46175f5d
- feat: Auto-inject kai-scheduler annotations and label (#2748) · 9e6972a5
  julienmancuso authored Aug 27, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9e6972a5