Commits · dbdbd5e5f02594d4b24185b4a7638adfd0802499 · OpenDAS / dynamo

"launch/vscode:/vscode.git/clone" did not exist on "b495cd839e6f24f0acdf8be4609c4bf43c9571d6"

24 Apr, 2025 4 commits
- refactor: transition CLI to use typer for UX and testing (#703) · f27cdbcb
  ishandhanani authored Apr 24, 2025
```
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  f27cdbcb
- feat: improve dynamo deployment CLI (#798) · c0bdf412
  hhzhang16 authored Apr 24, 2025
```
Co-authored-by: Julien Mancuso <jmancuso@nvidia.com>
```
  c0bdf412
- chore: Increase sleep times from 2s -> 30s for startup logs (#807) · aae0d405
  Ryan McCormick authored Apr 23, 2025
  
  aae0d405
- fix: Update TRTLLM version and fix disagg workflow (#804) · 197105eb
  Tanmay Verma authored Apr 23, 2025
  
  197105eb
23 Apr, 2025 2 commits
- chore: fix model arg name in multinode 405b example (#770) · 41f3e0e0
  KennyMcCormick authored Apr 24, 2025
```
Signed-off-by: cormick <cormick1080@gmail.com>
```
  41f3e0e0
- feat: allow to CRUD dynamo pipelines (#761) · de77d3f9
  julienmancuso authored Apr 22, 2025
  
  de77d3f9
22 Apr, 2025 2 commits
- docs: R1 disaggregation guide (#720) · e06bfd55
  GuanLuo authored Apr 22, 2025
  
  e06bfd55
- docs: deployment docs improvements (#753) · 5aa5d4b2
  hhzhang16 authored Apr 21, 2025
  
  5aa5d4b2
21 Apr, 2025 1 commit
- feat: add custom lease to worker components (#748) · c392c341
  ishandhanani authored Apr 21, 2025
  
  c392c341
18 Apr, 2025 2 commits
- docs: add aggregated deployment guide for multi-node sized model (#713) · 22cacbb1
  GuanLuo authored Apr 18, 2025
  
  22cacbb1
- feat: gracefully shutdown endpoint by revoking etcd lease + python binding (#730) · 4c38680e
  Hongkuan Zhou authored Apr 18, 2025
```
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  4c38680e
17 Apr, 2025 3 commits
- feat: Add disaggregated serving hello world example (#683) · eac3cf1f
  kYLe authored Apr 17, 2025
  
  eac3cf1f
- feat: configure logger with detail info (#654) · 50aa390b
  tlipoca9 authored Apr 18, 2025
```
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  50aa390b
- fix: direct clients vs dependancies (#704) · c30c6990
  ishandhanani authored Apr 16, 2025
```
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
```
  c30c6990
16 Apr, 2025 1 commit
- docs: Benchmarking guide updates (#678) · 48733546
  Jacky authored Apr 15, 2025
  
  48733546
15 Apr, 2025 4 commits
- feat: replace dynamo server with dynamo cloud (#696) · da482c2f
  hhzhang16 authored Apr 15, 2025
  
  da482c2f
- fix: frontend and http server signal handling (#677) · 643659c6
  Alec authored Apr 15, 2025
  
  643659c6
- docs: move deploy docs to docs/guides (#674) · 1c77531a
  hhzhang16 authored Apr 14, 2025
```
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1c77531a
- fix: set correct parent_hash for each kv block when publish kv events (#671) · 15455dff
  Ziqi Fan authored Apr 14, 2025
  
  15455dff
14 Apr, 2025 2 commits
- fix: deploy command should support passing config (#626) · 5b4e5496
  mohammedabdulwahhab authored Apr 14, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Julien Mancuso <jmancuso@nvidia.com>
```
  5b4e5496
- fix: signal handlers to clean up zombie vllm processes (#545) · 777e602b
  ishandhanani authored Apr 13, 2025
  
  777e602b
12 Apr, 2025 2 commits
- fix: change trtllm kv_router default block_size to 32 (#642) · 8edd23dc
  Ziqi Fan authored Apr 12, 2025
  
  8edd23dc
- feat: ETCD prefix watcher + python binding + runtime reconfiguration for... · 08fd2897
  Hongkuan Zhou authored Apr 11, 2025
```
feat: ETCD prefix watcher + python binding + runtime reconfiguration for router and disagg router  (#581)
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  08fd2897
11 Apr, 2025 6 commits

docs: Add documentation for UCX KV cache transfer in TRTLLM (#639) · 8d35dc43
Tanmay Verma authored Apr 11, 2025

8d35dc43
docs: Add instructions to install git lfs (#627) · ee986548
Tanmay Verma authored Apr 11, 2025

ee986548
fix: fix max_local_prefill_length not being printed out in disagg router log (#628) · 88e3779e
Hongkuan Zhou authored Apr 11, 2025

88e3779e

feat: TRT-LLM disaggregated serving using UCX (#562) · da38e96a

Tanmay Verma authored Apr 10, 2025


Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

da38e96a

docs: Guide for multi-node benchmarking (#561) · 538b4630

Jacky authored Apr 10, 2025

Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>

538b4630

docs: add to documentation for Kubernetes deployments, devcontainer improvements (#498) · 441846de

hhzhang16 authored Apr 10, 2025

441846de

10 Apr, 2025 3 commits
- docs: update dynamo serve trtllm agg example yaml files (#600) · 34be4418
  Ziqi Fan authored Apr 10, 2025
  
  34be4418
- fix: frontend now cleans up model from llmctl (#588) · bb4e819c
  Alec authored Apr 10, 2025
  
  bb4e819c
- chore: check prefix caching while using kv router (#592) · 7cf75628
  tlipoca9 authored Apr 10, 2025
```
Neelay approved merge
```
  7cf75628
09 Apr, 2025 4 commits

feat: Extract Common Configs + Log Configs on Init + Add `test_` to... · 0292feb5

jon-chuang authored Apr 09, 2025


feat: Extract Common Configs + Log Configs on Init + Add `test_` to `sdk/tests` filenames required for pytest (#434)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0292feb5

docs: Move trtllm dynamo run doc from example to dynamo run guide (#578) · 0186aa7b
Tanmay Verma authored Apr 09, 2025

0186aa7b

docs: Guides for single node benchmarking (#509) · 594f8c04

Jacky authored Apr 09, 2025


Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

594f8c04

docs: Clarify the --max-local-prefill-length help description (#554) · f8520e92

Jacky authored Apr 08, 2025


Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

f8520e92

08 Apr, 2025 1 commit

chore: Update TRTLLM version. Fix router. (#527) · 7dca64df

Tanmay Verma authored Apr 07, 2025


Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>

7dca64df

07 Apr, 2025 3 commits
- fix: clean unused bento pieces from serve.py and serving.py (#532) · f91d5488
  ishandhanani authored Apr 07, 2025
  
  f91d5488
- docs: update close-deployment in dynamo_serve.md (#535) · df54b9cb
  tlipoca9 authored Apr 08, 2025
```
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  df54b9cb
- fix: mypy error (#543) · 6eb31507
  ishandhanani authored Apr 07, 2025
```
Co-authored-by: finofliu <finofliu@tencent.com>
```
  6eb31507