Commits · fee976a2f9b630f5bdeca3c0cbc05add7cf054e9 · OpenDAS / dynamo

"tests/vscode:/vscode.git/clone" did not exist on "9be3df8f6853c6b1336c7b1fd704cf15f7c72450"

28 Aug, 2025 9 commits
- fix: Added description to async-openai/Cargo.toml (#2761) · fee976a2
  Dmitry Tokarev authored Aug 28, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fee976a2
- docs: add mermaid graph to .devcontainer/README.md, remove mount (revert). (#2632) · 357aa69e
  Keiven C authored Aug 28, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  357aa69e
- refactor: centralize Prometheus metrics naming and sanitization DIS-554 (#2733) · 84c9890b
  Keiven C authored Aug 28, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  84c9890b
- ci: add support for vllm sanity testing on Github (#2526) · 82bae247
  Anant Sharma authored Aug 28, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  82bae247
- chore: deprecate duplicate params in nvext (#2754) · e3619ce0
  ryan-lempka authored Aug 27, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  e3619ce0
- feat: Add vLLM multimodal video support (#2738) · 78a11074
  Kris Hung authored Aug 27, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  78a11074
- chore: Update support_matrix.md (#2735) · 46175f5d
  Dmitry Tokarev authored Aug 27, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  46175f5d
- feat: Auto-inject kai-scheduler annotations and label (#2748) · 9e6972a5
  julienmancuso authored Aug 27, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9e6972a5
- feat: add reference setup for dynamo logging in k8s with loki (#2699) · 700d345d
  mohammedabdulwahhab authored Aug 27, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  700d345d
27 Aug, 2025 9 commits
- fix: revisit grove and LWS selection (#2564) · 44ecfda5
  julienmancuso authored Aug 27, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  44ecfda5
- fix: Reflect actual status of Grove PGS in Dynamo DGD (#2710) · 60a6a96a
  julienmancuso authored Aug 27, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  60a6a96a
- chore: Add atchernych to deploy codeowners (#2751) · f99b569d
  atchernych authored Aug 27, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  f99b569d
- feat: Sglang metrics labels. (#2679) · bad5d122
  Tzu-Ling Kan authored Aug 27, 2025
  
  bad5d122
- feat: KServe gRPC support (#2638) · 91a459c0
  GuanLuo authored Aug 26, 2025
  
  91a459c0
- feat: Trtllm metric_labels. (#2666) · ef535edb
  Tzu-Ling Kan authored Aug 26, 2025
  
  ef535edb
- feat: allow specifying consumer name for NATS queue + manually purge old messages (#2740) · b9640e5c
  Yan Ru Pei authored Aug 26, 2025
  
  b9640e5c
- fix: container/Dockerfile.trtllm - use pytorch 2.8.0a0+5228986c39.nv25.5 (#2579) · 73f60feb
  Dmitry Tokarev authored Aug 26, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Misha Chornyi <99709299+mc-nv@users.noreply.github.com>
```
  73f60feb
- fix: add label to persist DGD name on downstream pods (#2729) · 6f8ce176
  mohammedabdulwahhab authored Aug 26, 2025
  
  6f8ce176
26 Aug, 2025 11 commits
- feat: Deployment for Dynamo EPP - aware gateway (#2633) · 490cdc18
  atchernych authored Aug 26, 2025
```
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  490cdc18
- fix: fix hello world (#2727) · ac9665c2
  mohammedabdulwahhab authored Aug 26, 2025
  
  ac9665c2
- feat: add and enable reasoning and tool parser flags for trtllm and sglang (#2713) · 8064849b
  nachiketb-nvidia authored Aug 26, 2025
  
  8064849b
- feat: Add vllm multimodal qwen aggregated support (#2694) · 50cd81f3
  Kris Hung authored Aug 26, 2025
  
  50cd81f3
- fix: sglang -- queue requests until model registration completes (#2701) · dfda6205
  hhzhang16 authored Aug 26, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  dfda6205
- fix: fix metrics docs; add dcgm-exporter (#2712) · 6cf96e02
  mohammedabdulwahhab authored Aug 26, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6cf96e02
- fix: fix sglang multinode example (#2716) · 36df35e4
  julienmancuso authored Aug 26, 2025
  
  36df35e4
- feat: align OpenAI response IDs with distributed trace IDs (#2496) · a485ab78
  Chi McIsaac authored Aug 26, 2025
  
  a485ab78
- docs: Update how containers should be built for SGLang examples (#2707) · 5d177b61
  Yunzhou Liu authored Aug 26, 2025
  
  5d177b61
- feat: HF_ENDPOINT addition (#2637) · 45e38d3d
  Michael Gathara authored Aug 26, 2025
  
  45e38d3d
- feat: parse normal text along with tool calls (#2709) · 889d6529
  Ayush Agarwal authored Aug 26, 2025
  
  889d6529
25 Aug, 2025 11 commits
- docs: Simplify sphinx build and table of contents on webpage (#2519) · 766d3f2c
  Ryan McCormick authored Aug 25, 2025
  
  766d3f2c
- feat: enable --dyn-reasoning-parser flag to set reasoning parser for vllm deployments (#2700) · f5a41004
  nachiketb-nvidia authored Aug 25, 2025
  
  f5a41004
- refactor: move uptime tracking from system_status_server(HTTP) to DRT level (#2587) · 68fb3d95
  Keiven C authored Aug 25, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  68fb3d95
- feat: python bindings for the entire KvPushRouter + per-request router configs (#2658) · f08729ae
  Yan Ru Pei authored Aug 25, 2025
  
  f08729ae
- refactor: Switch ModelManager locks from `std::sync::Mutex` to `parking_lot::Mutex` (#2696) · 8e4d81f3
  Paul Hendricks authored Aug 25, 2025
  
  8e4d81f3
- feat: support HF_HOME/_ENDPOINT env for Hugging Face models (#2642) · a24221d4
  Hyeonki Hong authored Aug 26, 2025
```
Signed-off-by: Hyeonki Hong <hhk7734@gmail.com>
```
  a24221d4
- feat: add prometheus to the runtime image for sglang (#2689) · 225aee52
  hhzhang16 authored Aug 25, 2025
  
  225aee52
- chore: vllm 0.10.1.1 (#2641) · 135dc82e
  Dmitry Tokarev authored Aug 25, 2025
  
  135dc82e
- feat: add gpt oss reasoning parser through harmony (#2656) · 3036e60b
  nachiketb-nvidia authored Aug 25, 2025
```
- couple of refactors
- added a new dependency, openai-harmony
- implemented the gpt oss parser
```
  3036e60b
- feat: add initial batch of KVBM metrics on match, offload and onboard (#2673) · b39382ba
  Ziqi Fan authored Aug 25, 2025
  
  b39382ba
- fix: correct planner test example after tokenizer fix (#2674) · 35055c6f
  Hongkuan Zhou authored Aug 25, 2025
  
  35055c6f