Commits · 0c0336e6ea3b7d8cd87b382e33a025007e90d686 · OpenDAS / dynamo · GitLab

04 Feb, 2026 9 commits
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
- chore: linux gate lib/memory (#5942) · 67df0065
  Yan Ru Pei authored Feb 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  67df0065
- feat: Various Mocker Perf improvements + fixes (#5808) · d22ca523
  jthomson04 authored Feb 04, 2026
```
Signed-off-by: jthomson04 <jothomson@nvidia.com>
```
  d22ca523
- fix: fuse unfold streams to prevent panics from poll after termination (#5872) · 7beb5f1a
  Janelle Cai authored Feb 04, 2026
  
  7beb5f1a
- fix: race between worker discovery and runtimeconfig discovery in KV router (#5924) · c7f6f6d9
  Janelle Cai authored Feb 03, 2026
```
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  c7f6f6d9
- feat(lora): add lora load estimator (#5880) · 72a12869
  Biswa Panda authored Feb 03, 2026
  
  72a12869
- docs: add overview doc for GPU Memory Service (GMS) (#5920) · 4f9a190c
  Biswa Panda authored Feb 03, 2026
```
Co-authored-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  4f9a190c
- feat: default with lib/memory, media-nixl and kvbm (#5602) · 8daacbd7
  milesial authored Feb 03, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  8daacbd7
- fix(runtime): return 500 on LoRA load/unload errors (#5626) · da0cbf68
  Ameen Patel authored Feb 03, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  da0cbf68
03 Feb, 2026 8 commits
- feat: image diffusion with SGLang diffusion (#5609) · 7e970d44
  Konrad Nowicki authored Feb 03, 2026
```
Signed-off-by: Konrad Nowicki <knowicki@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
```
  7e970d44
- feat: introducing ChReK (Checkpoint Restore in K8s) (#4978) · f3aa1e01
  Julien Mancuso authored Feb 03, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  f3aa1e01
- feat: Add EPP startup probe and adjust recipe - fixes [DEP-749] (#5770) · 2d602853
  atchernych authored Feb 03, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
Co-authored-by: Julien Mancuso <jmancuso@nvidia.com>
```
  2d602853
- feat: vLLM backend with frontend media decoding (#5781) · 9bff03f2
  milesial authored Feb 03, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  9bff03f2
- feat: prefill tokens threshold based on max num batched tokens frac (#5867) · a337113a
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a337113a
- feat: per dp rank gap detection (#5873) · 902eabd9
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  902eabd9
- feat(lora): Add lora_name tracking to scheduling and sequence management (#5875) · 373e76c1
  Biswa Panda authored Feb 02, 2026
  
  373e76c1
- feat(mocker): pre-fetch model and staggered launches (#5871) · 18d9d1fa
  Janelle Cai authored Feb 02, 2026
  
  18d9d1fa
02 Feb, 2026 3 commits
- chore: remove dead AllWorkersBusy handling in KvScheduler (#5869) · df4cd191
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  df4cd191
- chore: in discovery, use dashmap in place of mutex hashmap (#5868) · 8dd1fc07
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8dd1fc07
- fix: enable DP attention KV events for multi-node deployments (#5589) · c5f5ab60
  ishandhanani authored Feb 02, 2026
```
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: huitianbai <huitianbai@gmail.com>
Co-authored-by: Huitianqi Bai <huitianbai@users.noreply.github.com>
```
  c5f5ab60
31 Jan, 2026 1 commit
- chore: move HF config download and prevent duplicate concurrent model registration (#5767) · b88cb59b
  Janelle Cai authored Jan 30, 2026
  
  b88cb59b
30 Jan, 2026 3 commits
- chore: atomic file write (#5809) · aa4ac947
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  aa4ac947
- fix: CUDA synchronization to prevent sleep/wake race conditions (#5759) · 69fdc9dd
  Schwinn Saereesitthipitak authored Jan 29, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  69fdc9dd
- refactor: read offload priority env var once at init (#5798) · eef5e645
  Yuewei Na authored Jan 29, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  eef5e645
29 Jan, 2026 6 commits
- feat: add epp component (#5611) · 9e2a2cc9
  Julien Mancuso authored Jan 29, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9e2a2cc9
- feat: Implement priority-based KV cache offload filtering (#5563) · 6271a31f
  Yuewei Na authored Jan 29, 2026
```
Signed-off-by: Yuewei Na <248773860+nv-yna@users.noreply.github.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Signed-off-by: yna <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  6271a31f
- feat(sglang): integration with GPU Memory Service (#5664) · a2fbda3e
  Schwinn Saereesitthipitak authored Jan 29, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <17022745+galletas1712@users.noreply.github.com>
```
  a2fbda3e
- chore: consistently used the arc shared workers configs + CI flake fixes (#5707) · 584020f4
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  584020f4
- feat: remove deprecated events api (#5778) · 1174c819
  Biswa Panda authored Jan 28, 2026
  
  1174c819
- chore: clean ups in kv-router (#5771) · fc92fc18
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fc92fc18
28 Jan, 2026 8 commits
- fix: prevent duplicate Prometheus metrics from Python expfmt callbacks (#5761) · 5a00a7d6
  Keiven C authored Jan 28, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  5a00a7d6
- fix: emit first token creation signal after sleeping. (#5681) · 941ad640
  luc-hiverge authored Jan 28, 2026
```
Signed-off-by: Luc Grosheintz <luc@hiverge.ai>
```
  941ad640
- fix: gpu memory service cli not found (#5749) · 2ef408ff
  Schwinn Saereesitthipitak authored Jan 28, 2026
  
  2ef408ff
- chore: lift invariant logic out of loop (#5720) · 453cb26c
  Kante Yin authored Jan 28, 2026
```
Signed-off-by: kerthcet <kerthcet@gmail.com>
```
  453cb26c
- chore: Remove native-tls / openssl dependency (#5703) · 2ffd5847
  Graham King authored Jan 28, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2ffd5847
- fix: avoid Prometheus collisions via multi-registry scrape (#5678) · 3d62cc7f
  Keiven C authored Jan 28, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3d62cc7f
- chore: make core kv-router its own crate (#5677) · 649d9b7d
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  649d9b7d
- docs: DYN-1967 update metrics docs after kvstats removal (#5704) · 8e72fb69
  Keiven C authored Jan 27, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8e72fb69
27 Jan, 2026 2 commits
- chore: Bump rust lib oneshot to 0.1.13 (#5694) · 2d6babe5
  Dmitry Tokarev authored Jan 27, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  2d6babe5
- chore: Fix tests logging setup (#5693) · 90b07594
  Graham King authored Jan 27, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  90b07594