Commits · 5166a3dd442f58866b12b535c7a9900caaabedcf · OpenDAS / dynamo · GitLab

07 Aug, 2025 3 commits
- feat: Router replicas with state-sharing (#2264) · 5166a3dd
  Yan Ru Pei authored Aug 07, 2025
  
  5166a3dd
- feat: cross process instrumentation (#2243) · bd4fe1a7
  Neelay Shah authored Aug 07, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
```
  bd4fe1a7
- chore: Remove service_name from ModelDeploymentCard (#2349) · 1954fcfa
  Graham King authored Aug 07, 2025
  
  1954fcfa
06 Aug, 2025 3 commits
- chore: Bump mistral.rs, llama.cpp and tokenizers deps (#2338) · dbe48a1d
  Graham King authored Aug 06, 2025
  
  dbe48a1d
- fix: upgrade axum to 0.8 and etcd-client to 0.16 (#2317) · b2aa504b
  Dan Aloni authored Aug 06, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
```
  b2aa504b
- feat: Support static workers, run without etcd. (#2281) · 6a1a801c
  Graham King authored Aug 06, 2025
  
  6a1a801c
05 Aug, 2025 4 commits
- feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e
  Hongkuan Zhou authored Aug 05, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  36c4ef5e
- feat: Allow Python Engine to end stream before final (#2270) · 347620a1
  Jacky authored Aug 05, 2025
  
  347620a1
- feat: Pass user_data to register_llm for LoRA support (#2286) · 433f6012
  Chi authored Aug 05, 2025
  
  433f6012
- fix: show raw sglang logs given env var (#2287) · 4cbd4f38
  ishandhanani authored Aug 04, 2025
  
  4cbd4f38
31 Jul, 2025 2 commits
- chore: update nixl version to 0.4.1 (#2221) · 625578c3
  Anant Sharma authored Jul 31, 2025
  
  625578c3
- feat: skip downloading model weights if using mocker (only tokenizer) (#2213) · bae25dc6
  Yan Ru Pei authored Jul 31, 2025
  
  bae25dc6
30 Jul, 2025 1 commit
- chore: Version bump to 0.4.0 (#2179) · 4c90b1b9
  Dmitry Tokarev authored Jul 30, 2025
  
  4c90b1b9
26 Jul, 2025 1 commit
- refactor: Move engine and publisher from dynamo.llm.tensorrt_llm to dynamo.trtllm (#2128) · 222245e2
  Tanmay Verma authored Jul 25, 2025
  
  222245e2
24 Jul, 2025 1 commit
- chore(dynamo-run): Remove out=sglang|vllm|trtllm (#1920) · 19a77ae7
  Graham King authored Jul 23, 2025
  
  19a77ae7
23 Jul, 2025 2 commits
- fix: updates versions and adds ahashmap to BPE (#2072) · 66b7d2c7
  Paul Hendricks authored Jul 23, 2025
  
  66b7d2c7
- feat: Connect Library (#1478) · e0a51940
  J Wyman authored Jul 23, 2025
  
  e0a51940
22 Jul, 2025 1 commit
- chore: Remove unused portion of kv bindings test (#2052) · 9f2356cb
  Ryan McCormick authored Jul 22, 2025
  
  9f2356cb
18 Jul, 2025 2 commits
- feat: Add migration to LLM requests (#1930) · 1f07dab7
  Jacky authored Jul 18, 2025
  
  1f07dab7
- feat(frontend): router-mode settings (#2001) · fc124360
  Graham King authored Jul 18, 2025
  
  fc124360
16 Jul, 2025 3 commits
- chore(bindings): Remove mistralrs / llama.cpp (#1970) · 182d3b5d
  Graham King authored Jul 16, 2025
  
  182d3b5d
- feat: integrate mocker with dynamo-run and python cli (#1927) · f31732a2
  Yan Ru Pei authored Jul 16, 2025
  
  f31732a2
- perf(router): Remove lock from router hot path (#1963) · aba60996
  Graham King authored Jul 16, 2025
  
  aba60996
15 Jul, 2025 1 commit
- chore: Move examples/cli to lib/bindings/examples/cli (#1952) · 7b9182fd
  Graham King authored Jul 15, 2025
  
  7b9182fd
11 Jul, 2025 1 commit
- chore: update nixl to 0.4.0 release (#1860) (#1886) · d975761b
  Anant Sharma authored Jul 11, 2025
  
  d975761b
10 Jul, 2025 3 commits
- build: Revert "chore: update nixl to 0.4.0 release" (#1880) · 1704b126
  Tushar Sharma authored Jul 10, 2025
  
  1704b126
- refactor: vllm v1 examples (#1756) · f242b455
  Alec authored Jul 10, 2025
```
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  f242b455
- chore: update nixl to 0.4.0 release (#1860) · 5fa4cdda
  Anant Sharma authored Jul 10, 2025
  
  5fa4cdda
08 Jul, 2025 3 commits
- feat: Build DistributedRuntime-level HTTP server with /health /metrics (#1656) · ece76a62
  ZichengMa authored Jul 08, 2025
  
  ece76a62
- feat(python): Python bindings for the Dynamo CLI tools (#1799) · 2bf27924
  Graham King authored Jul 08, 2025
  
  2bf27924
- feat: predictive active blocks for routing without load metrics (#1731) · 84e71e27
  Yan Ru Pei authored Jul 08, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  84e71e27
07 Jul, 2025 3 commits
- feat: vllm speculative decoding metrics (#1549) · 439e977d
  jain-ria authored Jul 07, 2025
```
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  439e977d
- chore: update versions for 0.3.2 release (#1793) · c4935b34
  Anant Sharma authored Jul 07, 2025
  
  c4935b34
- feat: Failure Detection while Responses are returning (#1671) · b4ddca99
  Jacky authored Jul 07, 2025
  
  b4ddca99
03 Jul, 2025 2 commits
- chore: update nixl to latest 0.3.1 commit (#1762) · a9241b61
  Anant Sharma authored Jul 03, 2025
  
  a9241b61
- chore(engines): Upgrade mistralrs to 0.6.0 (#1767) · 4ab47617
  Graham King authored Jul 03, 2025
  
  4ab47617
01 Jul, 2025 4 commits
- fix: default to None initialization of routing config (#1713) · 0a32b344
  Alec authored Jul 01, 2025
  
  0a32b344
- feat: Support for Responses API (#1694) · dfbd741d
  Paul Hendricks authored Jul 01, 2025
  
  dfbd741d
- fix(bindings): Default router config in bindings (#1716) · edf00c5c
  Graham King authored Jul 01, 2025
```
  * Added a default temperature value for text generation requests when no temperature is specified.
  * Improved handling of missing configuration values to prevent errors during model initialization.
```
  edf00c5c
- fix: Fix main (#1712) · 6365a015
  jthomson04 authored Jun 30, 2025
  
  6365a015