Commits · a33033b7f6432386dc7766a5f0e56fa67bc7beaf · OpenDAS / dynamo

19 Aug, 2025 3 commits
- feat: task scheduler (#2406) · a33033b7
  Ryan Olson authored Aug 19, 2025
```
Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>
```
  a33033b7
- feat: router-level request rejection (#2465) · 85d83108
  Yan Ru Pei authored Aug 19, 2025
  
  85d83108
- fix: use tokio spawn / interval.tick(), make nats metric names clearer, fix... · bec1dd54
  Keiven C authored Aug 18, 2025
```
fix: use tokio spawn / interval.tick(), make nats metric names clearer, fix tests sharing environment variables (temp_env) (#2506)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bec1dd54
18 Aug, 2025 3 commits
- fix: small build warning fix (#2504) · 8cde945e
  nachiketb-nvidia authored Aug 18, 2025
```
Signed-off-by: nachiketb-nvidia <nachiketb@nvidia.com>
```
  8cde945e
- feat(http): TLS support (#2492) · a4bbe492
  Graham King authored Aug 18, 2025
  
  a4bbe492
- fix: replace metrics callback with background scraping to prevent tim… (#2480) · 04442173
  Keiven C authored Aug 18, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  04442173
15 Aug, 2025 1 commit
- feat(metrics): add NATS client metrics to prometheus_metrics_fmt (#2292) · acbdabc4
  Keiven C authored Aug 14, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  acbdabc4
14 Aug, 2025 2 commits
- perf: Only compute checksums on debug builds (#2446) · 9ddb3efd
  jthomson04 authored Aug 14, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  9ddb3efd
- feat: Add a "model" label to Component metrics (#2389) · 3a3f5bf2
  Tzu-Ling Kan authored Aug 14, 2025
  
  3a3f5bf2
13 Aug, 2025 2 commits
- fix: Fix ETCD and NATS starvation under massive request concurrency (#2384) · dcfa87be
  jthomson04 authored Aug 13, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  dcfa87be
- feat: Allow an endpoint to serve multiple models (#2418) · 72ec5f5c
  Graham King authored Aug 13, 2025
  
  72ec5f5c
11 Aug, 2025 1 commit
- refactor: rename to system status server for consistency (#2354) · c91e2e49
  Keiven C authored Aug 11, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c91e2e49
07 Aug, 2025 4 commits
- chore(metrics): Remove the Arc (#2357) · a3f7a39f
  Graham King authored Aug 07, 2025
  
  a3f7a39f
- feat: cross process instrumentation (#2243) · bd4fe1a7
  Neelay Shah authored Aug 07, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
```
  bd4fe1a7
- chore: Remove service_name from ModelDeploymentCard (#2349) · 1954fcfa
  Graham King authored Aug 07, 2025
  
  1954fcfa
- refactor: Rename HTTP server to metrics server in worker process (#2318) · 254f4819
  Yingge He authored Aug 06, 2025
  
  254f4819
05 Aug, 2025 5 commits
- ci: Improve caching on pre-merge-rust (#2253) · e95f8758
  Ryan McCormick authored Aug 05, 2025
  
  e95f8758
- feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e
  Hongkuan Zhou authored Aug 05, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  36c4ef5e
- feat: Allow Python Engine to end stream before final (#2270) · 347620a1
  Jacky authored Aug 05, 2025
  
  347620a1
- feat(health): extend /health endpoint to include instances (#1312) (#2011) · b48d4c3b
  heisenberglit authored Aug 05, 2025
  
  b48d4c3b
- feat: Parameterize health and live HTTP endpoint paths (#2230) · 7c8f8fdc
  Yingge He authored Aug 05, 2025
  
  7c8f8fdc
01 Aug, 2025 2 commits
- fix: dynamo_component to be added in metric names (#2180) · efd863d6
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  efd863d6
- fix: frontend metrics to be renamed from nv_llm_http_service_* => dynamo_frontend_* (#2176) · 8c75ed79
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8c75ed79
31 Jul, 2025 1 commit
- fix: Integration tests fixes (#2161) · f10e44ca
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f10e44ca
28 Jul, 2025 2 commits

feat: updates to structured logging (#2061) · 0cb01b3f

Neelay Shah authored Jul 28, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

0cb01b3f

feat: Base metrics: add generic ingress handler metrics (#2090) · 615580d8
Keiven C authored Jul 28, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
615580d8

23 Jul, 2025 1 commit
- feat: health check changes based on endpoint served (#1996) · b127d95f
  Neelay Shah authored Jul 22, 2025
  
  b127d95f
22 Jul, 2025 2 commits

feat: use atomic transactions when creating etcd kv (#2044) · 78826932
Yan Ru Pei authored Jul 22, 2025

78826932

feat: add a hierarchical Prometheus MetricsRegistry trait for... · e5a8628f

Keiven C authored Jul 22, 2025

feat: add a hierarchical Prometheus MetricsRegistry trait for DistributedRuntime, Namespace, Components, and Endpoint (#2008)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Ryan Olson <rolson@nvidia.com>

e5a8628f

18 Jul, 2025 2 commits
- feat: http disconnects (#2014) · 343a4814
  Ryan Olson authored Jul 18, 2025
  
  343a4814
- feat: Add migration to LLM requests (#1930) · 1f07dab7
  Jacky authored Jul 18, 2025
  
  1f07dab7
17 Jul, 2025 3 commits
- fix: Fix syntax for tokio-console (#1997) · f3fb09e4
  Kris Hung authored Jul 17, 2025
  
  f3fb09e4
- feat(runtime): Support tokio-console (#1986) · 1eadc013
  Graham King authored Jul 17, 2025
  
  1eadc013
- feat: record + analyze logprobs (#1957) · 49b7a0d9
  Ryan Olson authored Jul 17, 2025
  
  49b7a0d9
16 Jul, 2025 2 commits
- chore(bindings): Remove mistralrs / llama.cpp (#1970) · 182d3b5d
  Graham King authored Jul 16, 2025
  
  182d3b5d
- perf(router): Remove lock from router hot path (#1963) · aba60996
  Graham King authored Jul 16, 2025
  
  aba60996
15 Jul, 2025 3 commits
- feat: adding http clients and recorded response stream (#1919) · a9e0891c
  Ryan Olson authored Jul 15, 2025
  
  a9e0891c
- fix: Remove OpenSSL dependency, use Rust TLS (#1945) · 4da078b8
  Graham King authored Jul 15, 2025
  
  4da078b8
- chore: metrics endpoint variables renamed from HTTP_SERVER->SYSTEM (#1934) · 860f3f75
  Keiven C authored Jul 14, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  860f3f75
10 Jul, 2025 1 commit
- perf(runtime): Use all available parallelism (#1858) · da83f820
  Graham King authored Jul 10, 2025
  
  da83f820