Commits · d675d2218e5b271e8434cd03bb3384a2641f12b1 · OpenDAS / dynamo

09 May, 2025 1 commit
- feat: decouple dynamo sdk to support mutiple deployment targets (#905) · d675d221
  Biswa Panda authored May 08, 2025
  
  d675d221
07 May, 2025 1 commit
- feat: cleanup EtcdKvCache and PrefillQueue before and after launch (#925) · a590d103
  Hongkuan Zhou authored May 07, 2025
  
  a590d103
01 May, 2025 1 commit
- chore: reduce code repetition in processor (#919) · 2be5e8f5
  Yan Ru Pei authored Apr 30, 2025
  
  2be5e8f5
30 Apr, 2025 1 commit
- chore: unified logging, added informative warnings for KV router example (#912) · 2d39ded6
  Yan Ru Pei authored Apr 30, 2025
  
  2d39ded6
09 Apr, 2025 1 commit

feat: Extract Common Configs + Log Configs on Init + Add `test_` to... · 0292feb5

jon-chuang authored Apr 09, 2025


feat: Extract Common Configs + Log Configs on Init + Add `test_` to `sdk/tests` filenames required for pytest (#434)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0292feb5

07 Apr, 2025 1 commit
- fix: clean unused bento pieces from serve.py and serving.py (#532) · f91d5488
  ishandhanani authored Apr 07, 2025
  
  f91d5488
04 Apr, 2025 1 commit
- chore: cleaner required workers check (don't spam print) (#521) · 4c7dceca
  Yan Ru Pei authored Apr 04, 2025
  
  4c7dceca
26 Mar, 2025 1 commit
- chore: more Pythonic kv router cleanups in examples (#396) · a544d823
  Yan Ru Pei authored Mar 25, 2025
  
  a544d823
20 Mar, 2025 1 commit
- chore: KV router Pythonic cleanups (#324) · 43ff14ce
  Yan Ru Pei authored Mar 20, 2025
  
  43ff14ce
18 Mar, 2025 1 commit

feat: add local gpu allocation (#232) · 9f0181a8

Biswa Panda authored Mar 18, 2025


Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>

9f0181a8

17 Mar, 2025 4 commits
- chore: move examples to top level (#220) · 4b1867c5
  Neelay Shah authored Mar 17, 2025
  
  4b1867c5
- revert: "moving examples to top level" (#218) · 21b795e8
  Anant Sharma authored Mar 17, 2025
  
  21b795e8
- moving examples to top level · 8891aa0c
  nnshah1 authored Mar 17, 2025
  
  8891aa0c
- chore: refactor examples and clean CLI (#195) · df51a622
  ishandhanani authored Mar 16, 2025
  
  df51a622
15 Mar, 2025 1 commit

feat(deploy): Add examples for dynamo serve (#173) · b4aff959

Biswa Panda authored Mar 15, 2025


Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

b4aff959

14 Mar, 2025 2 commits
- fix: indent issue (duplicated source code) (#165) · 0694d6b5
  Hongkuan Zhou authored Mar 14, 2025
  
  0694d6b5
- feat(sdk): add initial graph structure for prebuilt components (#130) · b8120504
  ishandhanani authored Mar 14, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  b8120504
13 Mar, 2025 1 commit
- feat: onboard nixl based vllm example to dynamo serve (#120) · cab65e1a
  Biswa Panda authored Mar 12, 2025
  
  cab65e1a
11 Mar, 2025 3 commits
- refactor: rename vllm_nixl to vllm and make default (#100) · 5bcdb734
  Neelay Shah authored Mar 11, 2025
  
  5bcdb734
- feat: kv aware disagg router (#98) · a954a1c6
  Hongkuan Zhou authored Mar 11, 2025
```
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  a954a1c6
- feat: unified entry point for vllm-nixl (#83) · 30c5a79f
  Hongkuan Zhou authored Mar 10, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  30c5a79f
09 Mar, 2025 1 commit

feat: kv aware router + disagg router + prefill queue (#11) · 19844fc0

Hongkuan Zhou authored Mar 08, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

19844fc0

08 Mar, 2025 1 commit
- chore: rename dynamo (#44) · 602352ce
  Neelay Shah authored Mar 08, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  602352ce
06 Mar, 2025 1 commit
- feat: expose KV routing components for easier router customization (#15) · e159e53f
  GuanLuo authored Mar 05, 2025
  
  e159e53f
05 Mar, 2025 1 commit
- refactor: rename triton_distributed to dynemo (#22) · 1af7433b
  Neelay Shah authored Mar 05, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  1af7433b
28 Feb, 2025 1 commit
- [fix] KV Router Example fixes (#314) · 11a36651
  Alec authored Feb 28, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  11a36651
25 Feb, 2025 2 commits

feat: enable metrics polling · 861c5098

GuanLuo authored Feb 25, 2025

Signed-off-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan Olson <ryanolson@users.noreply.github.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Co-authored-by: Biswa Panda <biswapanda@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

861c5098

refactor: move libs to lib dir · 08fcd7e9

Neelay Shah authored Feb 24, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

08fcd7e9

21 Feb, 2025 1 commit

feat: Add http support to vllm kv router example (#217) · 15de1807

Alec authored Feb 21, 2025


Co-authored-by: Sean Choi <choishsean@gmail.com>
Co-authored-by: aflowers <aflowers@nvidia.com>

15de1807

18 Feb, 2025 1 commit

feat: Add KV publisher and receiver. Add KV aware routing example. · 8588e33a

GuanLuo authored Feb 18, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: aflowers <aflowers@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8588e33a