Commits · e6a6a1f2445dbc2ed026d440c0e5966e53dac9b0 · OpenDAS / dynamo

19 Dec, 2025 1 commit
- feat: Request Migration Metrics (#5029) · e6a6a1f2
  Jacky authored Dec 19, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e6a6a1f2
18 Dec, 2025 1 commit
- feat(frontend): First part of Python request handling (#4999) · da0f2fb8
  Graham King authored Dec 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  da0f2fb8
12 Dec, 2025 2 commits
- fix: cleaner prefill + decode discovery (#4927) · feb49914
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb49914
- fix: prefill discovery (#4911) · f790e921
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f790e921
11 Dec, 2025 2 commits
- feat: use os assigned free port for tcp rpc (#4891) · 64a30d3d
  Biswa Panda authored Dec 11, 2025
  
  64a30d3d
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
04 Dec, 2025 1 commit
- chore: no need to arc wrap client (#4741) · 5b24b429
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5b24b429
02 Dec, 2025 1 commit
- feat: dynamic setting of thresholds for rejection (#4673) · 4c1bc4ee
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c1bc4ee
26 Nov, 2025 1 commit
- fix: allow router to be registered as general transport type (#4633) · ea9d00e7
  Yan Ru Pei authored Nov 26, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ea9d00e7
25 Nov, 2025 2 commits
- chore: make router use the discovery pattern instead of manual kv watch (#4597) · 9c5018e5
  Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9c5018e5
- chore(runtime): Tidy up component paths (#4560) · 51c1b9f1
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  51c1b9f1
21 Nov, 2025 1 commit
- fix(storage): Correctly encoding FileStore keys (#4539) · 27904535
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  27904535
13 Nov, 2025 2 commits
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
08 Nov, 2025 1 commit
- fix: refactor to use service discovery (#4092) · 09b26bf6
  mohammedabdulwahhab authored Nov 08, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  09b26bf6
07 Nov, 2025 1 commit
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
30 Oct, 2025 1 commit
- chore: KV Router start using Store instead of etcd (#3945) · 13ce09ea
  Graham King authored Oct 30, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  13ce09ea
27 Oct, 2025 1 commit
- chore(discovery): Use Store interface instead of etcd (#3887) · 5a0d710b
  Graham King authored Oct 27, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  5a0d710b
23 Oct, 2025 1 commit
- chore: Use KeyValueStoreManager instead of etcd::Client (#3822) · 7731b024
  Graham King authored Oct 23, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7731b024
21 Oct, 2025 1 commit
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
18 Oct, 2025 1 commit
- feat: add prefill workers to discovery (#3709) · 4b7a806c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b7a806c
17 Oct, 2025 1 commit
- feat(frontend): Get model config files (`tokenizer.json` et al.) from MX (#3659) · 9d03b8dc
  Graham King authored Oct 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9d03b8dc
16 Oct, 2025 1 commit
- chore: move worker_monitor to the llm crate (#3667) · 7aa8e0e6
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7aa8e0e6
07 Oct, 2025 3 commits
- feat(etcd): Version the etcd keys (#3458) · a5371bfc
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  a5371bfc
- chore(discovery): Watch/publish ModelDeploymentCard instead of ModelEntry (#3350) · 81162dfe
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  81162dfe
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
03 Oct, 2025 1 commit
- fix: namespace not being considered on model delete (#3403) · c7cdc8cd
  Chi McIsaac authored Oct 03, 2025
```
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
```
  c7cdc8cd
30 Sep, 2025 3 commits
- chore: Add Key abstraction in our KeyValueStore (#3322) · 50cdae5f
  Graham King authored Sep 30, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  50cdae5f
- fix: python bindings for router should register to etcd as well (#3302) · d354763c
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d354763c
- chore: Move model_input, model_type from ModelEntry to ModelDeploymentCard (#3292) · 6ffd20a8
  Graham King authored Sep 30, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6ffd20a8
24 Sep, 2025 1 commit

feat: tensor type for generic inference. (#2746) · 6ba64c31

GuanLuo authored Sep 24, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6ba64c31

18 Sep, 2025 1 commit

feat: enhance GPT OSS frontend with improved harmony tool calling parser and... · 6675bfc8

zhongdaor-nv authored Sep 18, 2025


feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

6675bfc8

17 Sep, 2025 1 commit
- feat: Make part of discovery re-usable (#3073) · 9060ce12
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9060ce12
16 Sep, 2025 1 commit
- feat: add HTTP queue metrics for NIM frontend request tracking (#2914) · 9fa5450c
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9fa5450c
05 Sep, 2025 2 commits
- fix: Load the tokenizer JSON once for chat and completions. (#2910) · cb5a657a
  Graham King authored Sep 05, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cb5a657a
- refactor: Refactor discovery ModelManager to use `parking_lot::RwLock` (#2902) · 8065fe12
  Paul Hendricks authored Sep 05, 2025
```
Signed-off-by: Paul Hendricks <phendricks@nvidia.com>
```
  8065fe12
03 Sep, 2025 3 commits

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

feat: dynamo namespace isolation (#2394) · c6becbc8
Biswa Panda authored Sep 03, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
c6becbc8
chore: many bug fixes and improvements when testing planner (#2776) · 7da510cf
Hongkuan Zhou authored Sep 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: hongkuan <hongkuanz@nvidia.com>
```
7da510cf

30 Aug, 2025 1 commit
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709