Commits · 4b7a806c7a8eebbff11105151e395a9ee9b012eb · OpenDAS / dynamo

"docs/backends/vllm/README.md" did not exist on "dabfea3de57a5ffde74e8be97db4b9d063e00668"

18 Oct, 2025 1 commit
- feat: add prefill workers to discovery (#3709) · 4b7a806c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b7a806c
17 Oct, 2025 4 commits
- refactor: Make `nats_client` optional internally (#3705) · 66fd6f84
  Graham King authored Oct 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  66fd6f84
- chore: remove kv metrics scraping and aggregation (#3701) · 4c207e0c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c207e0c
- feat(frontend): Get model config files (`tokenizer.json` et al.) from MX (#3659) · 9d03b8dc
  Graham King authored Oct 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9d03b8dc
- feat: use non-blocking lock for radix uploading + a read lock for radix downloading (#3655) · e93170d6
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e93170d6
16 Oct, 2025 5 commits
- fix: deepseek tool parsing fixed (#3557) · e41fa1a0
  Elyas Mehtabuddin authored Oct 16, 2025
  
  e41fa1a0
- fix: handling 0 block transfer (#3613) · 1972f71f
  Olga Andreeva authored Oct 16, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  1972f71f
- chore: move worker_monitor to the llm crate (#3667) · 7aa8e0e6
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7aa8e0e6
- feat: Enable cancellation during or before a stream is established (#3635) · 734d2f87
  Jacky authored Oct 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  734d2f87
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 2 commits
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
- feat: router frees request from slot manager on stopped requests (#3623) · 6a1391eb
  Yan Ru Pei authored Oct 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6a1391eb
14 Oct, 2025 2 commits
- fix: Add support for single element arrays for chat and completions prompts (#3482) · 3dc25129
  zhongdaor-nv authored Oct 14, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  3dc25129
- test: Break parsers -> llm dependency (#3607) · 972adc37
  Graham King authored Oct 14, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  972adc37
13 Oct, 2025 3 commits
- fix: Improve Error Messaging for port/address already in use error (#3587) · fa4ce46c
  KrishnanPrash authored Oct 13, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  fa4ce46c
- feat: remove stale workers on snapshot + some refactoring (#3589) · b5e762b2
  Yan Ru Pei authored Oct 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b5e762b2
- feat: Metric histogram buckets configureable from env (#3562) · f0065bb4
  William Arnold authored Oct 13, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  f0065bb4
11 Oct, 2025 4 commits
- chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  c3fcfdd6
- feat: implement custom backend metrics for NIM (#3266) · 65cc5337
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  65cc5337
- feat: rm the old KVBM metrics | update G2 to G3 metrics collection (#3561) · 4224e57d
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  4224e57d
- feat: add SGLang and vLLM passthrough metrics on Dynamo backend worker (#3539) · 55e458d8
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  55e458d8
10 Oct, 2025 8 commits
- test: unit test for Router slot manager (#3559) · 6e8529fd
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6e8529fd
- chore: Remove model_config from LocalModel (#3558) · 0e0218ff
  Graham King authored Oct 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0e0218ff
- chore: upgrade nixl to 0.6.0 (#3550) · 5c69c119
  Richard Huo authored Oct 10, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  5c69c119
- feat: add KVBM host to disk metrics | clean up dashboard (#3534) · ca674098
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  ca674098
- chore: remove deprecated nvext parameters for 6.0 (#3551) · b954a249
  ryan-lempka authored Oct 10, 2025
  
  b954a249
- chore: use Rc to do reference counting in Router slot manager (#3545) · 227846f2
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  227846f2
- feat: add disk offloading filtering in KVBM (#3532) · b94ecd16
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  b94ecd16
- feat: Introduce storage_client in DistributedRuntime (#3507) · 7a7d397c
  Graham King authored Oct 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7a7d397c
09 Oct, 2025 1 commit
- feat: allow shutdown of orphaned kv consumers on Router startup (#3516) · 0844f8ee
  Yan Ru Pei authored Oct 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0844f8ee
08 Oct, 2025 5 commits
- feat: Add OpenAPI routes to serve HTTP server API documentation (#3480) · ef04a086
  Ryan McCormick authored Oct 08, 2025
  
  ef04a086
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
- feat: DIS-678 kvbm modularity: standalone metrics endpoint (#3433) · cf83794a
  Richard Huo authored Oct 08, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  cf83794a
- chore: Remove GGUF support (#3488) · 1b1265e6
  Graham King authored Oct 08, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  1b1265e6
07 Oct, 2025 4 commits
- perf: Improve performance of snapshot using a reverse lookup from block -> external hash (#3370) · 11694273
  blarson-b10 authored Oct 07, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  11694273
- feat(etcd): Version the etcd keys (#3458) · a5371bfc
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  a5371bfc
- chore(discovery): Watch/publish ModelDeploymentCard instead of ModelEntry (#3350) · 81162dfe
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  81162dfe
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
06 Oct, 2025 1 commit
- chore: added vllm tool + reasoning data (#3416) · d4b09631
  Ayush Agarwal authored Oct 06, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d4b09631