Commits · a590d10317080ab0fb708841bd776e123b8bdc48 · OpenDAS / dynamo

07 May, 2025 3 commits
- feat: cleanup EtcdKvCache and PrefillQueue before and after launch (#925) · a590d103
  Hongkuan Zhou authored May 07, 2025
  
  a590d103
- fix: Check nvext for ignore_eos and set min_tokens for benchmark consistency (#988) · 0a894cc3
  Ryan McCormick authored May 07, 2025
  
  0a894cc3
- fix: Create default sampling params only once during initialization (#982) · 5d89a0c8
  ptarasiewiczNV authored May 07, 2025
  
  5d89a0c8
06 May, 2025 2 commits
- feat: Migrate NATS Queue to Rust (#669) (#961) · c4213899
  jthomson04 authored May 06, 2025
  
  c4213899
- refactor: refactor dynamo deploy subfolder (#927) · 403344e5
  hhzhang16 authored May 06, 2025
  
  403344e5
05 May, 2025 2 commits
- feat: multi-thread (via asyncio.task) in processor (#904) · e0cd8489
  Hongkuan Zhou authored May 05, 2025
  
  e0cd8489
- fix: use primary lease for NixlMetadataStore (#928) · 9d643f1e
  Hongkuan Zhou authored May 05, 2025
  
  9d643f1e
01 May, 2025 1 commit
- chore: reduce code repetition in processor (#919) · 2be5e8f5
  Yan Ru Pei authored Apr 30, 2025
  
  2be5e8f5
30 Apr, 2025 2 commits
- docs: add an example on how to use `--service-name` flag to spin up a standalone service (#915) · a0a09df0
  ishandhanani authored Apr 30, 2025
  
  a0a09df0
- chore: unified logging, added informative warnings for KV router example (#912) · 2d39ded6
  Yan Ru Pei authored Apr 30, 2025
  
  2d39ded6
29 Apr, 2025 1 commit

docs: Fixes to dynamo deploy docs (#902) · d2635a7e

mohammedabdulwahhab authored Apr 29, 2025


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

d2635a7e

28 Apr, 2025 2 commits
- refactor: move logging config to runtime (#863) · 974201c8
  ishandhanani authored Apr 28, 2025
  
  974201c8
- feat: Add unified x86 / aarch64 (ARM) build for VLLM image (#839) · 566068dc
  Ryan McCormick authored Apr 28, 2025
  
  566068dc
26 Apr, 2025 1 commit

feat: local planner for 0.2.0 release (#398) · 7d5d6f8c

Hongkuan Zhou authored Apr 25, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
Co-authored-by: Ubuntu <ubuntu@dev-inst-2w1vokvyuts83rzn4n1k7mnzew9.us-central1-a.c.brevdevprod.internal>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

7d5d6f8c

25 Apr, 2025 5 commits
- fix: wrong lease_id (#833) · 6ce428a5
  Alec authored Apr 25, 2025
  
  6ce428a5
- feat: misc changes while deploying (#831) · 04e892d1
  hhzhang16 authored Apr 25, 2025
  
  04e892d1
- fix: Change default vLLM router to round-robin (#597) · 0e4fffbc
  Piotr Marcinkiewicz authored Apr 25, 2025
  
  0e4fffbc
- fix: remove dynamo cloud login (#824) · 12f72a42
  mohammedabdulwahhab authored Apr 25, 2025
  
  12f72a42
- refactor: refactor dynamo serve part-1/N (#788) · 16310b26
  Biswa Panda authored Apr 25, 2025
```
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
```
  16310b26
24 Apr, 2025 1 commit
- refactor: transition CLI to use typer for UX and testing (#703) · f27cdbcb
  ishandhanani authored Apr 24, 2025
```
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  f27cdbcb
23 Apr, 2025 2 commits
- chore: fix model arg name in multinode 405b example (#770) · 41f3e0e0
  KennyMcCormick authored Apr 24, 2025
```
Signed-off-by: cormick <cormick1080@gmail.com>
```
  41f3e0e0
- feat: allow to CRUD dynamo pipelines (#761) · de77d3f9
  julienmancuso authored Apr 22, 2025
  
  de77d3f9
22 Apr, 2025 2 commits
- docs: R1 disaggregation guide (#720) · e06bfd55
  GuanLuo authored Apr 22, 2025
  
  e06bfd55
- docs: deployment docs improvements (#753) · 5aa5d4b2
  hhzhang16 authored Apr 21, 2025
  
  5aa5d4b2
21 Apr, 2025 1 commit
- feat: add custom lease to worker components (#748) · c392c341
  ishandhanani authored Apr 21, 2025
  
  c392c341
18 Apr, 2025 2 commits
- docs: add aggregated deployment guide for multi-node sized model (#713) · 22cacbb1
  GuanLuo authored Apr 18, 2025
  
  22cacbb1
- feat: gracefully shutdown endpoint by revoking etcd lease + python binding (#730) · 4c38680e
  Hongkuan Zhou authored Apr 18, 2025
```
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  4c38680e
17 Apr, 2025 1 commit
- fix: direct clients vs dependancies (#704) · c30c6990
  ishandhanani authored Apr 16, 2025
```
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
```
  c30c6990
16 Apr, 2025 1 commit
- docs: Benchmarking guide updates (#678) · 48733546
  Jacky authored Apr 15, 2025
  
  48733546
15 Apr, 2025 3 commits
- feat: replace dynamo server with dynamo cloud (#696) · da482c2f
  hhzhang16 authored Apr 15, 2025
  
  da482c2f
- fix: frontend and http server signal handling (#677) · 643659c6
  Alec authored Apr 15, 2025
  
  643659c6
- docs: move deploy docs to docs/guides (#674) · 1c77531a
  hhzhang16 authored Apr 14, 2025
```
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1c77531a
14 Apr, 2025 1 commit
- fix: signal handlers to clean up zombie vllm processes (#545) · 777e602b
  ishandhanani authored Apr 13, 2025
  
  777e602b
12 Apr, 2025 1 commit

feat: ETCD prefix watcher + python binding + runtime reconfiguration for... · 08fd2897

Hongkuan Zhou authored Apr 11, 2025

feat: ETCD prefix watcher + python binding + runtime reconfiguration for router and disagg router (#581)
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

08fd2897

11 Apr, 2025 2 commits
- fix: fix max_local_prefill_length not being printed out in disagg router log (#628) · 88e3779e
  Hongkuan Zhou authored Apr 11, 2025
  
  88e3779e
- docs: Guide for multi-node benchmarking (#561) · 538b4630
  Jacky authored Apr 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  538b4630
10 Apr, 2025 2 commits
- fix: frontend now cleans up model from llmctl (#588) · bb4e819c
  Alec authored Apr 10, 2025
  
  bb4e819c
- chore: check prefix caching while using kv router (#592) · 7cf75628
  tlipoca9 authored Apr 10, 2025
```
Neelay approved merge
```
  7cf75628
09 Apr, 2025 2 commits

feat: Extract Common Configs + Log Configs on Init + Add `test_` to... · 0292feb5

jon-chuang authored Apr 09, 2025


feat: Extract Common Configs + Log Configs on Init + Add `test_` to `sdk/tests` filenames required for pytest (#434)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0292feb5

docs: Guides for single node benchmarking (#509) · 594f8c04

Jacky authored Apr 09, 2025


Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

594f8c04