Commits · 3c44b88e89408fc5f310c40a34a11206d13587f3 · OpenDAS / dynamo

"vllm/vscode:/vscode.git/clone" did not exist on "c070772802b72104af6f58b0801ef902dc95267a"

10 Mar, 2026 27 commits
- feat(perf): add frontend pipeline and tokio runtime perf metric definitions (#6731) · 3c44b88e
  Biswa Panda authored Mar 10, 2026
  
  3c44b88e
- docs: Add numbers to showcase MM router perf (#7166) · c619ce36
  Kris Hung authored Mar 10, 2026
  
  c619ce36
- fix: resolve 'auto' backend to concrete value in every situation (#7158) · 0c6a8024
  hhzhang16 authored Mar 10, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  0c6a8024
- feat: split monolithic requirements.txt and remove test deps from runtime image (#6656) · 3cebc864
  Anant Sharma authored Mar 10, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3cebc864
- fix: only add profiling data to mocker workers (#7164) · 14d928cb
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  14d928cb
- fix: add kv transfer config to planner vllm examples (#7163) · e4865b69
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  e4865b69
- fix(perf): Skip duplicate image downloads and unnecessary image processing in... · 6634f33f
  zhongdaor-nv authored Mar 10, 2026
```
fix(perf): Skip duplicate image downloads and unnecessary image processing in MM Router (vLLM) (#7080)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6634f33f
- build: remove builds release (#6949) · ae770ad7
  Pavithra Vijayakrishnan authored Mar 10, 2026
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  ae770ad7
- docs: document NIXL Prometheus telemetry metrics in observability guide (#7141) · 9ab2486a
  Keiven C authored Mar 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9ab2486a
- ci: OPS-3802: Increase trtllm timeout, skip unsupported tests (#7104) · 06e19690
  Dillon Cullinan authored Mar 10, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  06e19690
- fix: Reduce max_num_tokens in wide_ep dsr1 prefill worker (#7133) · 864de4be
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  864de4be
- test: update unsupported model name after AIC increase coverage (#7161) · aeaf45f5
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  aeaf45f5
- fix: Dont ignore non-zero exitcodes after running tests (#7149) · 09c09909
  Dillon Cullinan authored Mar 10, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  09c09909
- feat: add an auto GPU VRAM estimator for disagg-same-GPU (#6868) · 423e4b45
  Keiven C authored Mar 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  423e4b45
- feat: add extra CodeRabbit review guidelines for Python and pytest (#7144) · f0ac86e8
  Keiven C authored Mar 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f0ac86e8
- chore: Enable "multipart" feature of reqwest (#7084) · 5265787b
  Graham King authored Mar 10, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  5265787b
- fix: handle early arrivals (#7126) · b6852919
  Ryan Olson authored Mar 10, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  b6852919
- fix(mocker): align vLLM scheduler with v1 — drop watermark, LIFO preemption, retry loop (#7020) · 236cb17d
  Yan Ru Pei authored Mar 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  236cb17d
- fix: resolve HTTP port collisions when multiple workers share a process (#7063) · b407b419
  Biswa Panda authored Mar 09, 2026
  
  b407b419
- fix(ft-tests): avoid shlex.split corrupting JSON args in ServiceSpec setters (#7012) · 6945d47e
  Tzu-Ling Kan authored Mar 09, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  6945d47e
- refactor: remove benchmark shim, use AIPerf directly (#7074) · 419e936a
  Ben Hamm authored Mar 09, 2026
```
Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Saravana Periyasamy <saperiyasamy@nvidia.com>
```
  419e936a
- fix: propagate resolved backend and skip interpolation for aggregated configs (#7106) · 50818575
  hhzhang16 authored Mar 09, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  50818575
- fix: allow x-kubernetes-preserve-unknown-fields (#7128) · 0d5df9f6
  hhzhang16 authored Mar 09, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  0d5df9f6
- chore: bump aiperf and aiconfig to last RCs (#7138) · fc55f612
  Harrison Saturley-Hall authored Mar 09, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  fc55f612
- docs: correct dead kvstats metric names in Grafana dashboards and docs (#7123) · 8481236c
  Keiven C authored Mar 09, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8481236c
- fix: make snapshot CI image linter pass (#7124) · 3a09a559
  Schwinn Saereesitthipitak authored Mar 09, 2026
  
  3a09a559
- fix: Update free_gpu_memory_fraction for llama4 Maverick to avoid OOM in multinode setup (#7090) · f4e20810
  Indrajit Bhosale authored Mar 09, 2026
  
  f4e20810
09 Mar, 2026 13 commits
- feat(kv-router): P2P recovery for standalone KV indexer [DYN-2367] (#6934) · 48eb52e7
  Yan Ru Pei authored Mar 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  48eb52e7
- fix: reject guided_grammar with excessive nesting depth (#7091) · fab07d1c
  ishandhanani authored Mar 09, 2026
  
  fab07d1c
- fix: increase process group termination timeout from 2s to 8s (#7132) · df67ce16
  Yuewei Na authored Mar 09, 2026
```
Signed-off-by: Yuewei Na <yna@nvidia.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  df67ce16
- feat: add SGLang chat processor for frontend pre/post processing (#6834) · 51dfd760
  ishandhanani authored Mar 09, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  51dfd760
- feat: velo-backend (#6547) · 63d7c01c
  Ryan Olson authored Mar 09, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  63d7c01c
- fix: restrict dummy embedding value range for bypassing vLLM check in E/P/D (#7117) · 2cc92bfa
  GuanLuo authored Mar 09, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  2cc92bfa
- fix: Fix Intermittent KV router + mocker errors (#7108) · a274ef82
  jthomson04 authored Mar 09, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  a274ef82
- fix: snapshot children before process group kill to prevent GPU memory leaks (#7122) · fddbb84d
  Yuewei Na authored Mar 09, 2026
```
Signed-off-by: Yuewei Na <yna@nvidia.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  fddbb84d
- fix(prefill-router): pass preselected_worker in sync prefill fallback path (#7055) · e96f71ba
  Yan Ru Pei authored Mar 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e96f71ba
- fix: use profiler DGD gen route in naive fallback mode (#7099) · 41b357d8
  Hongkuan Zhou authored Mar 09, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  41b357d8
- feat: add missing overrides (#7017) · 8f3188d3
  hhzhang16 authored Mar 09, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  8f3188d3
- fix: strip apiVersion/kind/metadata from overrides.dgd before merging (#7109) · 175d9196
  hhzhang16 authored Mar 09, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  175d9196
- docs: update support matrix and release artifacts for v0.9.1 (#7044) · 3ec78ec3
  dagil-nvidia authored Mar 09, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  3ec78ec3