Commits · e3d00b899f0c8a417cdfc45106c94bba5e3836a3 · OpenDAS / dynamo

23 Apr, 2026 1 commit

feat: Tier-based KV Routing (#8380) · e3d00b89

jthomson04 authored Apr 23, 2026


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

e3d00b89

13 Apr, 2026 1 commit
- feat: add KV cache transfer estimated latency metric for disaggregated serving (#7590) · 1ebe7060
  Jonathan Tong authored Apr 13, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  1ebe7060
09 Apr, 2026 1 commit
- fix(llm): preserve unresolved dp rank routing (#8000) · b579a772
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b579a772
03 Mar, 2026 1 commit
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
11 Feb, 2026 2 commits
- feat: Metric for detokenization latency (#6160) · adaf1a39
  Graham King authored Feb 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  adaf1a39
- feat: add router-level Prometheus metrics and centralize request tracking (#6146) · f46720c9
  Yan Ru Pei authored Feb 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  f46720c9
10 Feb, 2026 1 commit
- feat: Add metric tokenizer_latency_ms (#6092) · f1bcb175
  Graham King authored Feb 10, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f1bcb175
04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Jan, 2026 1 commit
- feat: mockers with bootstrap optimization (sglang testing) + CI test (#5121) · 0980b27f
  Yan Ru Pei authored Jan 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0980b27f
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
22 Dec, 2025 1 commit
- feat: add auto-generated frontend OpenAPI spec and helper binary (#4802) · f63e273c
  smatta-star authored Dec 22, 2025
```
Signed-off-by: Satvik Matta <smatta@nvidia.com>
```
  f63e273c
18 Dec, 2025 1 commit
- feat: unify per-request metric tracking (#5004) · 85b5c808
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  85b5c808
11 Dec, 2025 1 commit

feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f

Yan Ru Pei authored Dec 10, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>

2845aa1f