Commits · 1954fcfa09825e13d140fb98a9ad3d113bf66bdd · OpenDAS / dynamo · GitLab

07 Aug, 2025 2 commits
- chore: Remove service_name from ModelDeploymentCard (#2349) · 1954fcfa
  Graham King authored Aug 07, 2025
  
  1954fcfa
- fix: improve HF token handling in preprocessor tests (#2321) · ccc8815b
  Keiven C authored Aug 06, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  ccc8815b
06 Aug, 2025 4 commits
- fix: Restore running single-process without etcd (#2342) · 63fbf498
  Graham King authored Aug 06, 2025
  
  63fbf498
- chore: Bump mistral.rs, llama.cpp and tokenizers deps (#2338) · dbe48a1d
  Graham King authored Aug 06, 2025
  
  dbe48a1d
- feat: Support static workers, run without etcd. (#2281) · 6a1a801c
  Graham King authored Aug 06, 2025
  
  6a1a801c
- feat: recorder graceful drop (#2327) · 0802ecd9
  Yan Ru Pei authored Aug 05, 2025
  
  0802ecd9
05 Aug, 2025 2 commits
- feat(health): extend /health endpoint to include instances (#1312) (#2011) · b48d4c3b
  heisenberglit authored Aug 05, 2025
  
  b48d4c3b
- feat: Pass user_data to register_llm for LoRA support (#2286) · 433f6012
  Chi authored Aug 05, 2025
  
  433f6012
01 Aug, 2025 2 commits
- fix: frontend metrics to be renamed from nv_llm_http_service_* => dynamo_frontend_* (#2176) · 8c75ed79
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8c75ed79
- feat: reduce / revert routing overheads, do not consider output tokens (#2182) · 66231cf0
  Yan Ru Pei authored Jul 31, 2025
  
  66231cf0
31 Jul, 2025 3 commits
- chore: update nixl version to 0.4.1 (#2221) · 625578c3
  Anant Sharma authored Jul 31, 2025
  
  625578c3
- fix: fix endpoint run to return error DIS-325 (#2156) · cbc0e200
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  cbc0e200
- feat: skip downloading model weights if using mocker (only tokenizer) (#2213) · bae25dc6
  Yan Ru Pei authored Jul 31, 2025
  
  bae25dc6
28 Jul, 2025 2 commits
- chore: Add Request Migration docs and minor enhancements (#2038) · fdcf611f
  Jacky authored Jul 28, 2025
  
  fdcf611f
- feat: proper local hashes for mockers + router watches endpoints (#2132) · 803bfa81
  Yan Ru Pei authored Jul 28, 2025
  
  803bfa81
24 Jul, 2025 3 commits
- test: add router e2e test with mockers to per-merge ci (#2073) · ba3ac235
  Yan Ru Pei authored Jul 24, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  ba3ac235
- feat: dump radix tree as router events (#2057) · 2fc65ad8
  Yan Ru Pei authored Jul 24, 2025
  
  2fc65ad8
- chore(dynamo-run): Remove out=sglang|vllm|trtllm (#1920) · 19a77ae7
  Graham King authored Jul 23, 2025
  
  19a77ae7
23 Jul, 2025 5 commits
- docs: Update docs for new UX (#2070) · 3c500ae7
  Graham King authored Jul 23, 2025
  
  3c500ae7
- feat: query instance_id based on routing strategy (#1787) · f3d784f3
  Biswa Panda authored Jul 23, 2025
  
  f3d784f3
- fix: updates versions and adds ahashmap to BPE (#2072) · 66b7d2c7
  Paul Hendricks authored Jul 23, 2025
  
  66b7d2c7
- fix: endpoint changes should be prioritized over new requests in kv scheduler (#2071) · ffb54096
  Yan Ru Pei authored Jul 23, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  ffb54096
- fix: cryptic error message for empty messages list in /chat/completions #2067 (#2067) · 6a69ef4f
  heisenberglit authored Jul 23, 2025
  
  6a69ef4f
18 Jul, 2025 4 commits
- feat: http disconnects (#2014) · 343a4814
  Ryan Olson authored Jul 18, 2025
  
  343a4814
- feat: enable / disable chunked prefill for mockers (#2015) · e330d969
  Yan Ru Pei authored Jul 18, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  e330d969
- feat: Add migration to LLM requests (#1930) · 1f07dab7
  Jacky authored Jul 18, 2025
  
  1f07dab7
- feat(frontend): router-mode settings (#2001) · fc124360
  Graham King authored Jul 18, 2025
  
  fc124360
17 Jul, 2025 2 commits
- feat: support separate chat_template.jinja file (#1853) · b62e633c
  GuanLuo authored Jul 17, 2025
  
  b62e633c
- feat: record + analyze logprobs (#1957) · 49b7a0d9
  Ryan Olson authored Jul 17, 2025
  
  49b7a0d9
16 Jul, 2025 1 commit
- feat: integrate mocker with dynamo-run and python cli (#1927) · f31732a2
  Yan Ru Pei authored Jul 16, 2025
  
  f31732a2
15 Jul, 2025 2 commits
- feat: adding http clients and recorded response stream (#1919) · a9e0891c
  Ryan Olson authored Jul 15, 2025
  
  a9e0891c
- fix: Remove OpenSSL dependency, use Rust TLS (#1945) · 4da078b8
  Graham King authored Jul 15, 2025
  
  4da078b8
14 Jul, 2025 3 commits
- fix: resolve incorrect finish reason propagation (#1857) · 053041e6
  Jorge António authored Jul 15, 2025
  
  053041e6
- feat: prefill aware routing (#1895) · df91fce2
  Yan Ru Pei authored Jul 14, 2025
  
  df91fce2
- chore: envvars for http paths and live health endpoint (#1846) · c7080419
  Greg Clark authored Jul 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  c7080419
11 Jul, 2025 1 commit
- chore: update nixl to 0.4.0 release (#1860) (#1886) · d975761b
  Anant Sharma authored Jul 11, 2025
  
  d975761b
10 Jul, 2025 4 commits
- build: Revert "chore: update nixl to 0.4.0 release" (#1880) · 1704b126
  Tushar Sharma authored Jul 10, 2025
  
  1704b126
- feat: allow using ApproxKvIndexer for routing via use_kv_events flag (#1869) · 13640e15
  Yan Ru Pei authored Jul 10, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  13640e15
- perf(tokenizer): Make de-tokenize ~50% faster (#1868) · 61a1f4ff
  Graham King authored Jul 10, 2025
  
  61a1f4ff
- refactor: vllm v1 examples (#1756) · f242b455
  Alec authored Jul 10, 2025
```
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  f242b455