Commits · fda022b1c35d2cef3afe32fdec6822ed316fb67b · OpenDAS / dynamo

"deploy/inference-gateway/epp/vscode:/vscode.git/clone" did not exist on "457db719d199964f9c401c20218cbd69059fc371"

11 Mar, 2026 19 commits
- test(frontend): Minimal integration test for vllm processor (#7173) · fda022b1
  Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fda022b1
- chore(test): declutter router common.py into helper and router_process modules (#7210) · 96a55928
  Yan Ru Pei authored Mar 11, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  96a55928
- ci: allow deploy jobs to be cancelled by concurrency groups (#7169) · e094a2db
  Tushar Sharma authored Mar 11, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e094a2db
- feat: forward pass metric via ZMQ in vllm (#7200) · af30b779
  Hongkuan Zhou authored Mar 11, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  af30b779
- docs: fix image link (#7227) · 834eea61
  Neal Vaidya authored Mar 11, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  834eea61
- fix: Use deepgemm backend for qwen3-235b recipe (#7204) · 4af0f92e
  Tanmay Verma authored Mar 11, 2026
  
  4af0f92e
- chore: Build for slightly more modern CPUs (#7220) · 819661b3
  Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  819661b3
- docs: Add Nemotron-3-Super-FP8 deployment recipes (#7216) · edd50f64
  Neal Vaidya authored Mar 11, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  edd50f64
- docs: tighten .ai/ review guidelines based on CodeRabbit feedback (#7201) · 5101f08c
  Keiven C authored Mar 11, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  5101f08c
- fix: Update UCX Ref for Performance (#7212) · 727d32d7
  Adit Ranadive authored Mar 11, 2026
```
Signed-off-by: Adit Ranadive <aranadive@nvidia.com>
```
  727d32d7
- fix: removing reference to async-ucx (#7213) · ddf50359
  Ryan Olson authored Mar 11, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  ddf50359
- chore: set kvbm subcrates to 0.1.0 (#7147) · eb99f293
  Ryan Olson authored Mar 11, 2026
  
  eb99f293
- fix: serialize disagg first_gen_log_probs int keys for Rust transport (#7145) · e930526b
  Yuewei Na authored Mar 10, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  e930526b
- fix: Fix mocker+router segfaults + reliability fixes (#7162) · 761e848b
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  761e848b
- fix(operator): prevent nil pointer panic when DGD service omits replicas (#6739) · a31cbd0d
  Raghav Potluri authored Mar 10, 2026
```
Signed-off-by: Raghav Potluri <raghav.potluri21@gmail.com>
```
  a31cbd0d
- chore: update aiperf to 0.6.0 and aic v0.7.0rc14 (#7193) · 0f974b47
  Harrison Saturley-Hall authored Mar 10, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  0f974b47
- feat: hide optimizationType (#7160) · 611e856d
  hhzhang16 authored Mar 10, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  611e856d
- feat(anthropic): add thinking block support and preamble stripping to /v1/messages (#7137) · 012236ee
  MatejKosec authored Mar 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  012236ee
- chore: skip lmcache tests on cuda13 env (#7196) · 9eec94b2
  Dmitry Tokarev authored Mar 10, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  9eec94b2
10 Mar, 2026 21 commits
- chore: set velo crates to initial v0.1.0 (#7156) · 72e849e7
  Ryan Olson authored Mar 10, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  72e849e7
- fix: curl - retry DNS failures too (#7009) · 0c94f00f
  Dmitry Tokarev authored Mar 10, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  0c94f00f
- fix: populate profilingResults, clear profilingPhase, and update Profiling... · fce90859
  hhzhang16 authored Mar 10, 2026
```
fix: populate profilingResults, clear profilingPhase, and update Profiling condition after profiling completes (#7116)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  fce90859
- docs: add Agentic Workloads feature guide (#6982) · 218cb13c
  akshatha-k authored Mar 10, 2026
```
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Bryan Bednarski <bbednarski@nvidia.com>
```
  218cb13c
- fix: set correct component type in agg planner (#7176) · f435da14
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f435da14
- fix: Fix Qwen3-8b-fp8 recipe (#7010) · b7224eb5
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  b7224eb5
- feat: Add Loki log aggregation, and enable unified OTLP ingestion for both... · 734c0b8b
  jh-nv authored Mar 10, 2026
```
feat: Add Loki log aggregation, and enable unified OTLP ingestion for both traces and logs through a single endpoint (#6974)
```
  734c0b8b
- docs: 1.0 documentation improvements (#7168) · 96f3bdcc
  dagil-nvidia authored Mar 10, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  96f3bdcc
- feat: Qwen3-VL-30B recipe for agg embedding cache with vLLM patch (#6919) · 5e51d6dd
  Elijah Soba authored Mar 10, 2026
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  5e51d6dd
- docs: fix disaggregated deployment example in tracing.md (#6999) · fa474d36
  dagil-nvidia authored Mar 10, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  fa474d36
- feat(perf): add frontend pipeline and tokio runtime perf metric definitions (#6731) · 3c44b88e
  Biswa Panda authored Mar 10, 2026
  
  3c44b88e
- docs: Add numbers to showcase MM router perf (#7166) · c619ce36
  Kris Hung authored Mar 10, 2026
  
  c619ce36
- fix: resolve 'auto' backend to concrete value in every situation (#7158) · 0c6a8024
  hhzhang16 authored Mar 10, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  0c6a8024
- feat: split monolithic requirements.txt and remove test deps from runtime image (#6656) · 3cebc864
  Anant Sharma authored Mar 10, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3cebc864
- fix: only add profiling data to mocker workers (#7164) · 14d928cb
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  14d928cb
- fix: add kv transfer config to planner vllm examples (#7163) · e4865b69
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  e4865b69
- fix(perf): Skip duplicate image downloads and unnecessary image processing in... · 6634f33f
  zhongdaor-nv authored Mar 10, 2026
```
fix(perf): Skip duplicate image downloads and unnecessary image processing in MM Router (vLLM) (#7080)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6634f33f
- build: remove builds release (#6949) · ae770ad7
  Pavithra Vijayakrishnan authored Mar 10, 2026
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  ae770ad7
- docs: document NIXL Prometheus telemetry metrics in observability guide (#7141) · 9ab2486a
  Keiven C authored Mar 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9ab2486a
- ci: OPS-3802: Increase trtllm timeout, skip unsupported tests (#7104) · 06e19690
  Dillon Cullinan authored Mar 10, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  06e19690
- fix: Reduce max_num_tokens in wide_ep dsr1 prefill worker (#7133) · 864de4be
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  864de4be