Commits · a590d10317080ab0fb708841bd776e123b8bdc48 · OpenDAS / dynamo

07 May, 2025 2 commits
- feat: cleanup EtcdKvCache and PrefillQueue before and after launch (#925) · a590d103
  Hongkuan Zhou authored May 07, 2025
  
  a590d103
- fix: Create default sampling params only once during initialization (#982) · 5d89a0c8
  ptarasiewiczNV authored May 07, 2025
  
  5d89a0c8
05 May, 2025 1 commit
- feat: multi-thread (via asyncio.task) in processor (#904) · e0cd8489
  Hongkuan Zhou authored May 05, 2025
  
  e0cd8489
01 May, 2025 1 commit
- chore: reduce code repetition in processor (#919) · 2be5e8f5
  Yan Ru Pei authored Apr 30, 2025
  
  2be5e8f5
30 Apr, 2025 1 commit
- chore: unified logging, added informative warnings for KV router example (#912) · 2d39ded6
  Yan Ru Pei authored Apr 30, 2025
  
  2d39ded6
28 Apr, 2025 1 commit
- refactor: move logging config to runtime (#863) · 974201c8
  ishandhanani authored Apr 28, 2025
  
  974201c8
26 Apr, 2025 1 commit

feat: local planner for 0.2.0 release (#398) · 7d5d6f8c

Hongkuan Zhou authored Apr 25, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
Co-authored-by: Ubuntu <ubuntu@dev-inst-2w1vokvyuts83rzn4n1k7mnzew9.us-central1-a.c.brevdevprod.internal>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

7d5d6f8c

25 Apr, 2025 2 commits
- fix: wrong lease_id (#833) · 6ce428a5
  Alec authored Apr 25, 2025
  
  6ce428a5
- refactor: refactor dynamo serve part-1/N (#788) · 16310b26
  Biswa Panda authored Apr 25, 2025
```
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
```
  16310b26
21 Apr, 2025 1 commit
- feat: add custom lease to worker components (#748) · c392c341
  ishandhanani authored Apr 21, 2025
  
  c392c341
18 Apr, 2025 1 commit
- feat: gracefully shutdown endpoint by revoking etcd lease + python binding (#730) · 4c38680e
  Hongkuan Zhou authored Apr 18, 2025
```
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  4c38680e
17 Apr, 2025 1 commit
- fix: direct clients vs dependancies (#704) · c30c6990
  ishandhanani authored Apr 16, 2025
```
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
```
  c30c6990
15 Apr, 2025 1 commit
- fix: frontend and http server signal handling (#677) · 643659c6
  Alec authored Apr 15, 2025
  
  643659c6
14 Apr, 2025 1 commit
- fix: signal handlers to clean up zombie vllm processes (#545) · 777e602b
  ishandhanani authored Apr 13, 2025
  
  777e602b
12 Apr, 2025 1 commit

feat: ETCD prefix watcher + python binding + runtime reconfiguration for... · 08fd2897

Hongkuan Zhou authored Apr 11, 2025

feat: ETCD prefix watcher + python binding + runtime reconfiguration for router and disagg router (#581)
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

08fd2897

11 Apr, 2025 1 commit
- fix: fix max_local_prefill_length not being printed out in disagg router log (#628) · 88e3779e
  Hongkuan Zhou authored Apr 11, 2025
  
  88e3779e
10 Apr, 2025 2 commits
- fix: frontend now cleans up model from llmctl (#588) · bb4e819c
  Alec authored Apr 10, 2025
  
  bb4e819c
- chore: check prefix caching while using kv router (#592) · 7cf75628
  tlipoca9 authored Apr 10, 2025
```
Neelay approved merge
```
  7cf75628
09 Apr, 2025 1 commit

feat: Extract Common Configs + Log Configs on Init + Add `test_` to... · 0292feb5

jon-chuang authored Apr 09, 2025


feat: Extract Common Configs + Log Configs on Init + Add `test_` to `sdk/tests` filenames required for pytest (#434)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0292feb5

07 Apr, 2025 1 commit
- fix: clean unused bento pieces from serve.py and serving.py (#532) · f91d5488
  ishandhanani authored Apr 07, 2025
  
  f91d5488
04 Apr, 2025 1 commit
- chore: cleaner required workers check (don't spam print) (#521) · 4c7dceca
  Yan Ru Pei authored Apr 04, 2025
  
  4c7dceca
31 Mar, 2025 1 commit
- fix: prefill queue handler async task should not silently error (#442) · fcdcb12f
  jon-chuang authored Mar 30, 2025
  
  fcdcb12f
26 Mar, 2025 2 commits
- feat: Decode -> Prefill cached kv transfer (#340) · 17827e1d
  ptarasiewiczNV authored Mar 26, 2025
  
  17827e1d
- chore: more Pythonic kv router cleanups in examples (#396) · a544d823
  Yan Ru Pei authored Mar 25, 2025
  
  a544d823
24 Mar, 2025 1 commit
- feat: conditional disagg based on prefill queue size (#303) · d29f7fcc
  Hongkuan Zhou authored Mar 24, 2025
  
  d29f7fcc
20 Mar, 2025 1 commit
- chore: KV router Pythonic cleanups (#324) · 43ff14ce
  Yan Ru Pei authored Mar 20, 2025
  
  43ff14ce
19 Mar, 2025 3 commits
- feat: `Frontend` component uses served_model_name instead of model (#302) · 1f6ccc7f
  ishandhanani authored Mar 19, 2025
  
  1f6ccc7f
- chore: remove older unused components (#300) · 476174f3
  ishandhanani authored Mar 19, 2025
  
  476174f3
- fix: Add __init__.py for compoments folder in llm example (#299) · ff3413be
  Piotr Marcinkiewicz authored Mar 19, 2025
  
  ff3413be
18 Mar, 2025 1 commit

feat: add local gpu allocation (#232) · 9f0181a8

Biswa Panda authored Mar 18, 2025


Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>

9f0181a8

17 Mar, 2025 5 commits
- fix: propogate env vars from input cli/yaml into process (#208) · a611726e
  ishandhanani authored Mar 17, 2025
  
  a611726e
- docs: Update dynamo serve disagg example (#212) · 41ec2338
  ptarasiewiczNV authored Mar 17, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  41ec2338
- chore: move examples to top level (#220) · 4b1867c5
  Neelay Shah authored Mar 17, 2025
  
  4b1867c5
- revert: "moving examples to top level" (#218) · 21b795e8
  Anant Sharma authored Mar 17, 2025
  
  21b795e8
- moving examples to top level · 8891aa0c
  nnshah1 authored Mar 17, 2025
  
  8891aa0c