Commits · e95f8758885332be6759b898bc29cdd586f2b907 · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "ac50dccf95a74a40887fb71edd7a96569e28de8d"

05 Aug, 2025 7 commits
- ci: Improve caching on pre-merge-rust (#2253) · e95f8758
  Ryan McCormick authored Aug 05, 2025
  
  e95f8758
- feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e
  Hongkuan Zhou authored Aug 05, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  36c4ef5e
- feat: Allow Python Engine to end stream before final (#2270) · 347620a1
  Jacky authored Aug 05, 2025
  
  347620a1
- feat(health): extend /health endpoint to include instances (#1312) (#2011) · b48d4c3b
  heisenberglit authored Aug 05, 2025
  
  b48d4c3b
- feat: Parameterize health and live HTTP endpoint paths (#2230) · 7c8f8fdc
  Yingge He authored Aug 05, 2025
  
  7c8f8fdc
- feat: Pass user_data to register_llm for LoRA support (#2286) · 433f6012
  Chi authored Aug 05, 2025
  
  433f6012
- fix: show raw sglang logs given env var (#2287) · 4cbd4f38
  ishandhanani authored Aug 04, 2025
  
  4cbd4f38
01 Aug, 2025 3 commits
- fix: dynamo_component to be added in metric names (#2180) · efd863d6
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  efd863d6
- fix: frontend metrics to be renamed from nv_llm_http_service_* => dynamo_frontend_* (#2176) · 8c75ed79
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8c75ed79
- feat: reduce / revert routing overheads, do not consider output tokens (#2182) · 66231cf0
  Yan Ru Pei authored Jul 31, 2025
  
  66231cf0
31 Jul, 2025 4 commits
- fix: Integration tests fixes (#2161) · f10e44ca
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f10e44ca
- chore: update nixl version to 0.4.1 (#2221) · 625578c3
  Anant Sharma authored Jul 31, 2025
  
  625578c3
- fix: fix endpoint run to return error DIS-325 (#2156) · cbc0e200
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  cbc0e200
- feat: skip downloading model weights if using mocker (only tokenizer) (#2213) · bae25dc6
  Yan Ru Pei authored Jul 31, 2025
  
  bae25dc6
30 Jul, 2025 1 commit
- chore: Version bump to 0.4.0 (#2179) · 4c90b1b9
  Dmitry Tokarev authored Jul 30, 2025
  
  4c90b1b9
28 Jul, 2025 4 commits
- chore: Add Request Migration docs and minor enhancements (#2038) · fdcf611f
  Jacky authored Jul 28, 2025
  
  fdcf611f
- feat: updates to structured logging (#2061) · 0cb01b3f
  Neelay Shah authored Jul 28, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  0cb01b3f
- feat: proper local hashes for mockers + router watches endpoints (#2132) · 803bfa81
  Yan Ru Pei authored Jul 28, 2025
  
  803bfa81
- feat: Base metrics: add generic ingress handler metrics (#2090) · 615580d8
  Keiven C authored Jul 28, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  615580d8
26 Jul, 2025 1 commit
- refactor: Move engine and publisher from dynamo.llm.tensorrt_llm to dynamo.trtllm (#2128) · 222245e2
  Tanmay Verma authored Jul 25, 2025
  
  222245e2
25 Jul, 2025 1 commit
- fix: move docker-compose.yml to deploy/, and update frontend port (#2121) · 4498a77d
  Keiven C authored Jul 25, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  4498a77d
24 Jul, 2025 3 commits
- test: add router e2e test with mockers to per-merge ci (#2073) · ba3ac235
  Yan Ru Pei authored Jul 24, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  ba3ac235
- feat: dump radix tree as router events (#2057) · 2fc65ad8
  Yan Ru Pei authored Jul 24, 2025
  
  2fc65ad8
- chore(dynamo-run): Remove out=sglang|vllm|trtllm (#1920) · 19a77ae7
  Graham King authored Jul 23, 2025
  
  19a77ae7
23 Jul, 2025 7 commits
- docs: Update docs for new UX (#2070) · 3c500ae7
  Graham King authored Jul 23, 2025
  
  3c500ae7
- feat: query instance_id based on routing strategy (#1787) · f3d784f3
  Biswa Panda authored Jul 23, 2025
  
  f3d784f3
- fix: updates versions and adds ahashmap to BPE (#2072) · 66b7d2c7
  Paul Hendricks authored Jul 23, 2025
  
  66b7d2c7
- fix: endpoint changes should be prioritized over new requests in kv scheduler (#2071) · ffb54096
  Yan Ru Pei authored Jul 23, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  ffb54096
- feat: Connect Library (#1478) · e0a51940
  J Wyman authored Jul 23, 2025
  
  e0a51940
- fix: cryptic error message for empty messages list in /chat/completions #2067 (#2067) · 6a69ef4f
  heisenberglit authored Jul 23, 2025
  
  6a69ef4f
- feat: health check changes based on endpoint served (#1996) · b127d95f
  Neelay Shah authored Jul 22, 2025
  
  b127d95f
22 Jul, 2025 3 commits
- chore: Remove unused portion of kv bindings test (#2052) · 9f2356cb
  Ryan McCormick authored Jul 22, 2025
  
  9f2356cb
- feat: use atomic transactions when creating etcd kv (#2044) · 78826932
  Yan Ru Pei authored Jul 22, 2025
  
  78826932
- feat: add a hierarchical Prometheus MetricsRegistry trait for... · e5a8628f
  Keiven C authored Jul 22, 2025
```
feat: add a hierarchical Prometheus MetricsRegistry trait for DistributedRuntime, Namespace, Components, and Endpoint (#2008)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Ryan Olson <rolson@nvidia.com>
```
  e5a8628f
18 Jul, 2025 4 commits
- feat: http disconnects (#2014) · 343a4814
  Ryan Olson authored Jul 18, 2025
  
  343a4814
- feat: enable / disable chunked prefill for mockers (#2015) · e330d969
  Yan Ru Pei authored Jul 18, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  e330d969
- feat: Add migration to LLM requests (#1930) · 1f07dab7
  Jacky authored Jul 18, 2025
  
  1f07dab7
- feat(frontend): router-mode settings (#2001) · fc124360
  Graham King authored Jul 18, 2025
  
  fc124360
17 Jul, 2025 2 commits
- fix: Fix syntax for tokio-console (#1997) · f3fb09e4
  Kris Hung authored Jul 17, 2025
  
  f3fb09e4
- feat(runtime): Support tokio-console (#1986) · 1eadc013
  Graham King authored Jul 17, 2025
  
  1eadc013