Commits · 47897f364bb40e7b8daa3647af4b697319239056 · OpenDAS / dynamo · GitLab

14 Apr, 2026 21 commits
- feat: add gpu memory service API on engine services (#8148) · 47897f36
  mohammedabdulwahhab authored Apr 14, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  47897f36
- chore: remove deprecated examples/multimodal directory (#8141) · 617d55c0
  Ryan McCormick authored Apr 14, 2026
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  617d55c0
- fix(tests): re-enable vLLM LoRA tests and fix gpu_1 test flakiness (#8094) · 326a702d
  Keiven C authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenc@nvidia.com>
```
  326a702d
- feat: add bash launch script guidelines for CodeRabbit review (#7913) · a5b384f7
  Keiven C authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a5b384f7
- docs: Request cancellation metrics and mechanism (#8138) · da28df97
  Jacky authored Apr 14, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  da28df97
- feat: propagate otel tracing to trtllm E/P/D workers (#7592) · 34ce777d
  Jie Hao authored Apr 14, 2026
  
  34ce777d
- test: reorganize and prune GPU Memory Service tests (#7828) · b78ec99a
  Schwinn Saereesitthipitak authored Apr 14, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  b78ec99a
- ci: set skopeo runner to be prod-skopeo-v1 (#8102) · 11bb8498
  Ran Rubin authored Apr 14, 2026
```
Signed-off-by: rrubin <rrubin@nvidia.com>
```
  11bb8498
- feat: expose multimodal embedding cache metrics via Prometheus (#8031) · 96476be5
  Krishnan Prashanth authored Apr 14, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  96476be5
- fix(runtime): graceful removal of disagg model from /v1/models when prefill engine dies (#7131) · d2aad651
  Biswa Panda authored Apr 14, 2026
  
  d2aad651
- feat(gms): exported GMS handles on allocation (#8108) · 49feb284
  Schwinn Saereesitthipitak authored Apr 13, 2026
  
  49feb284
- feat: add fasttokens benchmarks and tokenizer backend docs (#7388) · 8f4bd3b4
  Biswa Panda authored Apr 13, 2026
  
  8f4bd3b4
- fix(gms): restore default allocator cleanup before checkpoint (#8049) · 6f5b460c
  Schwinn Saereesitthipitak authored Apr 13, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  6f5b460c
- fix(replay): short-circuit .npz planner imports (#8050) · 31909ca3
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  31909ca3
- feat(mocker): emit forward pass metrics to event plane for planner consumption (#8032) · 4e6c3964
  jthomson04 authored Apr 13, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  4e6c3964
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
- docs: Request rejection metrics (#8139) · b35db6e2
  Jacky authored Apr 13, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  b35db6e2
- feat: router, metric only add queue isl tokens (#8136) · eac6a5fc
  Michael Feil authored Apr 13, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  eac6a5fc
- feat(planner): add optimization_target for easy-mode scaling (#8137) · 9cf9ef18
  Hongkuan Zhou authored Apr 13, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9cf9ef18
- feat: Decoder clean-up for handling incomplete multi-byte sequence (#8022) · 2cabf441
  Biswa Panda authored Apr 13, 2026
  
  2cabf441
- fix(deps): pin mio after lockfile drift (#8080) · 20ce329b
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  20ce329b
13 Apr, 2026 18 commits
- feat(sglang): add ephemeral KV session routing (#7665) · 9498f016
  ishandhanani authored Apr 13, 2026
```
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  9498f016
- fix(ci): move test_multimodal_b64 to gpu_1 and force tool calls in... · 6bfc6d1f
  knarangN authored Apr 13, 2026
```
fix(ci): move test_multimodal_b64 to gpu_1 and force tool calls in aggregated_toolcalling (DYN-2662) (#8126)
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  6bfc6d1f
- fix: disagg_same_gpu - profiling markers, GPU pinning, and memory args (#7996) · e3e728a8
  Keiven C authored Apr 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  e3e728a8
- fix(kvbm): query NCCL version at runtime instead of hardcoding (#8130) · 47c4bd46
  Alec authored Apr 13, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
```
  47c4bd46
- fix(test): unskip test_smoke by switching to trtllm attention backend (DYN-2607) (#8104) · 9bc6d98d
  Yuewei Na authored Apr 13, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  9bc6d98d
- feat: add KV cache transfer estimated latency metric for disaggregated serving (#7590) · 1ebe7060
  Jonathan Tong authored Apr 13, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  1ebe7060
- feat: adds support to pass local tokenizer path (#8128) · e41e1715
  yunzhoul-nv authored Apr 13, 2026
```
Signed-off-by: Yunzhou Liu <232973175+yunzhoul-nv@users.noreply.github.com>
```
  e41e1715
- feat(runtime): add DYN_TCP_RESPONSE_STREAM_PORT/HOST env vars for configurable... · 3acdc0f8
  Biswa Panda authored Apr 13, 2026
```
feat(runtime): add DYN_TCP_RESPONSE_STREAM_PORT/HOST env vars for configurable response stream server port
```
  3acdc0f8
- fix: populate input_tokens in Anthropic streaming + add model retrieval endpoint (#7234) · f7fe8005
  MatejKosec authored Apr 13, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f7fe8005
- docs(router): split router docs into focused pages (#8122) · 49087845
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49087845
- chore: upgrade sglang dependency from 0.5.9 to 0.5.10.post1 (#7997) · e48de6aa
  Krishnan Prashanth authored Apr 13, 2026
```
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e48de6aa
- fix(kvbm): handle typed KvCacheConnectorConfig in consolidator check (#8117) · edce7d3d
  Alec authored Apr 13, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
```
  edce7d3d
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
- feat(kvbm): build kvbm wheel with nccl feature for CUDA containers (#8120) · a3e6468d
  Alec authored Apr 13, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
```
  a3e6468d
- fix(kv-router): wake queue on remote lifecycle (#8097) · 36e8b8c8
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  36e8b8c8
- docs: add GLM-5 NVFP4 recipe to recipes README (#8098) · a0c7025d
  Alec authored Apr 13, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  a0c7025d
- fix(frontend): classify cancelled requests as 499 instead of 500 (#8090) · 1284237e
  Thomas Montfort authored Apr 13, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  1284237e
- chore(multimodal): Add XPU aggregated video vLLM launch example (#7855) · 934b49ef
  Yi Yao authored Apr 13, 2026
```
Signed-off-by: Yi Yao <yi.a.yao@intel.com>
```
  934b49ef
11 Apr, 2026 1 commit
- feat: Add glm-5 nvfp4 recipe (#7780) · 59df10d1
  William Arnold authored Apr 10, 2026
```
Signed-off-by: William Arnold <warnold@nvidia.com>
```
  59df10d1