Commits · d1545621102a10ae70cd45ec9e644544858e59b1 · OpenDAS / dynamo

15 Jan, 2026 2 commits
- fix: consolidate return statement in get_engine_runtime_config (#5442) · d1545621
  dagil-nvidia authored Jan 15, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  d1545621
- fix: rename test file to skip vllm specific tests (#5438) · d02619b8
  jh-nv authored Jan 15, 2026
  
  d02619b8
14 Jan, 2026 3 commits
- chore(router): Remove deprecated best_worker_id and metrics_labels (#5412) · c5458b99
  Graham King authored Jan 14, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c5458b99
- fix: Properly handle multiple text components from request (#5196) · e22bb037
  jh-nv authored Jan 14, 2026
  
  e22bb037
- refactor: vllm EPD refactor (#4994) · 334cbd9b
  GuanLuo authored Jan 14, 2026
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  334cbd9b
13 Jan, 2026 1 commit
- feat: Propagate OTEL tracing context for trtllm (#5377) · 8c129ed4
  jh-nv authored Jan 13, 2026
  
  8c129ed4
12 Jan, 2026 3 commits
- feat: allow router not assuming decode kv reuse (#5350) · 7fdc742e
  Yan Ru Pei authored Jan 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fdc742e
- fix: pass back `usage` when using text mode with VLLM (#5336) · 68235126
  Qidong Su authored Jan 12, 2026
```
Signed-off-by: Qidong Su <soodoshll@gmail.com>
```
  68235126
- fix(sglang): use external_trace_header API for distributed tracing (#5346) · cbbaa6b7
  ishandhanani authored Jan 13, 2026
```
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  cbbaa6b7
09 Jan, 2026 2 commits
- fix: Fix decode worker in vllm for qwen_vl models (#5281) · 5cd8005c
  Indrajit Bhosale authored Jan 09, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  5cd8005c
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
08 Jan, 2026 3 commits
- chore: move custom mm preprocessor to new file (#5278) · 1c9fea01
  Ayush Agarwal authored Jan 08, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1c9fea01
- feat(vllm): Add prompt embeds support for pre-computed inference inputs (#4739) · 6f9619a2
  Wenqi Glantz authored Jan 08, 2026
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  6f9619a2
- fix(vllmsglang): Give sglang/vllm the HF model name not the full path (#5274) · fcc4a60f
  Graham King authored Jan 08, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fcc4a60f
07 Jan, 2026 4 commits
- revert: remove vLLM backend metrics from planner (#4134) (#5185) · daa1d740
  daiyaanarfeen authored Jan 07, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
```
  daa1d740
- feat: ec connector handler (#5162) · 85e0512f
  Ayush Agarwal authored Jan 07, 2026
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  85e0512f
- fix: Optimize TRTLLM multimodal request processing by reusing the tokenizer (#5217) · 535528a5
  Indrajit Bhosale authored Jan 07, 2026
  
  535528a5
- fix: KvCacheConfig Settings Lost When Publishing Events (#5198) · 66dfc494
  Indrajit Bhosale authored Jan 07, 2026
  
  66dfc494
06 Jan, 2026 2 commits
- fix: update vLLM to 0.13.0 with API compatibility fixes (#5222) · a1333a8d
  Alec authored Jan 06, 2026
```
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Vasilis Vagias <vvagias@nvidia.com>
```
  a1333a8d
- fix: handle concurrent load lora calls (#5184) · 07721d1c
  Biswa Panda authored Jan 05, 2026
  
  07721d1c
05 Jan, 2026 1 commit
- fix: the error when encountering pure text conversations (#5088) · ea950355
  shpgy-shpgy authored Jan 06, 2026
```
Signed-off-by: shpgy-shpgy <875664365@qq.com>
```
  ea950355
04 Jan, 2026 1 commit
- fix: sglang metrics and prefill router fix (#5147) · 007c5b60
  ishandhanani authored Jan 04, 2026
  
  007c5b60
03 Jan, 2026 2 commits
- fix(sglang): expose TokenizerMetricsCollector metrics via Prometheus (#5120) · 3e341fd6
  ishandhanani authored Jan 03, 2026
  
  3e341fd6
- feat: mockers with bootstrap optimization (sglang testing) + CI test (#5121) · 0980b27f
  Yan Ru Pei authored Jan 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0980b27f
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

30 Dec, 2025 1 commit

fix: Fix TRTLLM disagg with kv router (#4950) · d7c27e68

jthomson04 authored Dec 29, 2025


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

d7c27e68

26 Dec, 2025 1 commit
- fix(sglang): restore fallback for disaggregated decode without --router-mode kv (#5075) · 7053bb25
  ishandhanani authored Dec 26, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  7053bb25
19 Dec, 2025 2 commits
- chore: clean up PreprocessedRequest (#5040) · f4245c99
  Yan Ru Pei authored Dec 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f4245c99
- refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc
  Keiven C authored Dec 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c22280cc
18 Dec, 2025 4 commits
- feat: switch to tcp as default request plane (#4845) · 18b64e90
  Biswa Panda authored Dec 18, 2025
  
  18b64e90
- feat: propagate trace context to vLLM engine (#4918) · b401a1d6
  jh-nv authored Dec 18, 2025
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  b401a1d6
- fix(prefill): IPv6-ready bootstrap host resolution for sglang (#3019) · 845064bc
  dmitrygx authored Dec 18, 2025
```
Signed-off-by: Dmitrii Gabor <dmitryg1709@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  845064bc
- feat(frontend): First part of Python request handling (#4999) · da0f2fb8
  Graham King authored Dec 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  da0f2fb8
17 Dec, 2025 2 commits

feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483

Sean SH Choi authored Dec 17, 2025


Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

1c39e483

chore: Add vllm multimodal tests to pre_merge (#4889) · fb1b4f92
Kris Hung authored Dec 18, 2025

fb1b4f92

16 Dec, 2025 1 commit

test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf

Keiven C authored Dec 16, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6da23fcf

15 Dec, 2025 2 commits
- fix(vllm): warn that stream interval is not respected for now (#4650) · bbeb2808
  Alec authored Dec 15, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  bbeb2808
- feat: Mistral-3-large support (#4885) · 44a2cba9
  jthomson04 authored Dec 14, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  44a2cba9
12 Dec, 2025 1 commit
- chore: enable local indexers for sglang and trtllm (#4932) · c2a29f80
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c2a29f80