Commits · 08fd28978c1480e5ec07f4dc82d9befa24908230 · OpenDAS / dynamo

12 Apr, 2025 1 commit

feat: ETCD prefix watcher + python binding + runtime reconfiguration for... · 08fd2897

Hongkuan Zhou authored Apr 11, 2025

feat: ETCD prefix watcher + python binding + runtime reconfiguration for router and disagg router (#581)
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

08fd2897

11 Apr, 2025 1 commit
- fix: fix max_local_prefill_length not being printed out in disagg router log (#628) · 88e3779e
  Hongkuan Zhou authored Apr 11, 2025
  
  88e3779e
10 Apr, 2025 2 commits
- fix: frontend now cleans up model from llmctl (#588) · bb4e819c
  Alec authored Apr 10, 2025
  
  bb4e819c
- chore: check prefix caching while using kv router (#592) · 7cf75628
  tlipoca9 authored Apr 10, 2025
```
Neelay approved merge
```
  7cf75628
09 Apr, 2025 1 commit

feat: Extract Common Configs + Log Configs on Init + Add `test_` to... · 0292feb5

jon-chuang authored Apr 09, 2025


feat: Extract Common Configs + Log Configs on Init + Add `test_` to `sdk/tests` filenames required for pytest (#434)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0292feb5

07 Apr, 2025 1 commit
- fix: clean unused bento pieces from serve.py and serving.py (#532) · f91d5488
  ishandhanani authored Apr 07, 2025
  
  f91d5488
04 Apr, 2025 1 commit
- chore: cleaner required workers check (don't spam print) (#521) · 4c7dceca
  Yan Ru Pei authored Apr 04, 2025
  
  4c7dceca
31 Mar, 2025 1 commit
- fix: prefill queue handler async task should not silently error (#442) · fcdcb12f
  jon-chuang authored Mar 30, 2025
  
  fcdcb12f
26 Mar, 2025 2 commits
- feat: Decode -> Prefill cached kv transfer (#340) · 17827e1d
  ptarasiewiczNV authored Mar 26, 2025
  
  17827e1d
- chore: more Pythonic kv router cleanups in examples (#396) · a544d823
  Yan Ru Pei authored Mar 25, 2025
  
  a544d823
24 Mar, 2025 1 commit
- feat: conditional disagg based on prefill queue size (#303) · d29f7fcc
  Hongkuan Zhou authored Mar 24, 2025
  
  d29f7fcc
20 Mar, 2025 1 commit
- chore: KV router Pythonic cleanups (#324) · 43ff14ce
  Yan Ru Pei authored Mar 20, 2025
  
  43ff14ce
19 Mar, 2025 3 commits
- feat: `Frontend` component uses served_model_name instead of model (#302) · 1f6ccc7f
  ishandhanani authored Mar 19, 2025
  
  1f6ccc7f
- chore: remove older unused components (#300) · 476174f3
  ishandhanani authored Mar 19, 2025
  
  476174f3
- fix: Add __init__.py for compoments folder in llm example (#299) · ff3413be
  Piotr Marcinkiewicz authored Mar 19, 2025
  
  ff3413be
18 Mar, 2025 1 commit

feat: add local gpu allocation (#232) · 9f0181a8

Biswa Panda authored Mar 18, 2025


Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>

9f0181a8

17 Mar, 2025 5 commits
- fix: propogate env vars from input cli/yaml into process (#208) · a611726e
  ishandhanani authored Mar 17, 2025
  
  a611726e
- docs: Update dynamo serve disagg example (#212) · 41ec2338
  ptarasiewiczNV authored Mar 17, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  41ec2338
- chore: move examples to top level (#220) · 4b1867c5
  Neelay Shah authored Mar 17, 2025
  
  4b1867c5
- revert: "moving examples to top level" (#218) · 21b795e8
  Anant Sharma authored Mar 17, 2025
  
  21b795e8
- moving examples to top level · 8891aa0c
  nnshah1 authored Mar 17, 2025
  
  8891aa0c