Commits · 4a2235d1b995d38e5828942b3b16acb91176af76 · OpenDAS / dynamo

09 Jan, 2026 16 commits
- feat: vllm sglang cuda13 main (#5218) · 4a2235d1
  Dmitry Tokarev authored Jan 09, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  4a2235d1
- fix: pass HF token to pytest container (#5326) · 9bb7f101
  Dmitry Tokarev authored Jan 09, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  9bb7f101
- fix: Fix decode worker in vllm for qwen_vl models (#5281) · 5cd8005c
  Indrajit Bhosale authored Jan 09, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  5cd8005c
- test: Expand time range for flaky recorder test to improve stability (#5315) · 403ff669
  Ryan McCormick authored Jan 09, 2026
  
  403ff669
- docs: update readme for pip install ai-dynamo[trtllm] (#5312) · b1fc99ca
  Anant Sharma authored Jan 09, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  b1fc99ca
- perf: Fix prefill router round robin (#5313) · b39aa54f
  jthomson04 authored Jan 09, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  b39aa54f
- fix: remove unused prometheus port args in trtllm planner DGD (#5314) · 2e381b3e
  Hongkuan Zhou authored Jan 09, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2e381b3e
- fix: add subcomponenttype to recipes missing this field (#5301) · cf55e8b8
  Hongkuan Zhou authored Jan 09, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cf55e8b8
- feat: mount model path to Profiler if specified (#5212) · ec5630ea
  hhzhang16 authored Jan 09, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  ec5630ea
- docs: add host and bootstrap port to disagg multinode example (#5309) · c29f78c1
  dagil-nvidia authored Jan 09, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  c29f78c1
- fix: reduce VLLM_MOE_DP_CHUNK_SIZE to 384 (#5307) · 5f8d90a3
  ptarasiewiczNV authored Jan 09, 2026
```
Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  5f8d90a3
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
- fix: KServe propagate error to client in stream infer (#5263) · bb8eaa23
  GuanLuo authored Jan 08, 2026
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  bb8eaa23
- fix: distributed tracing propagation for TCP transport (#5283) · ace35a8e
  jh-nv authored Jan 08, 2026
```
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  ace35a8e
- docs: broken links in benchmarking documentation (#5258) · d0cfc40a
  Janelle Cai authored Jan 08, 2026
  
  d0cfc40a
- fix: add HF_TOKEN to pytests (#5298) · fcb76854
  Dmitry Tokarev authored Jan 08, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fcb76854
08 Jan, 2026 13 commits
- feat(operator): DynamoGraphDeployment rollout restart mechanism (#5118) · 3d67474e
  Thomas Montfort authored Jan 08, 2026
  
  3d67474e
- fix: preserve original model path for frontend config downloads (#5102) · f7ba417e
  ゆり authored Jan 09, 2026
```
Signed-off-by: yurekami <yurekami@users.noreply.github.com>
Co-authored-by: yurekami <yurekami@users.noreply.github.com>
```
  f7ba417e
- chore: move custom mm preprocessor to new file (#5278) · 1c9fea01
  Ayush Agarwal authored Jan 08, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1c9fea01
- fix: Add symlink for NCCL in trtllm container (#5257) · 22e36dec
  Tanmay Verma authored Jan 08, 2026
  
  22e36dec
- feat(vllm): Add prompt embeds support for pre-computed inference inputs (#4739) · 6f9619a2
  Wenqi Glantz authored Jan 08, 2026
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  6f9619a2
- fix: add mem frac for sglang dsr1 8gpu (#5260) · bfb95df7
  Hongkuan Zhou authored Jan 08, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bfb95df7
- fix: Update model cache pvc name (#5270) · 6458ef80
  ptarasiewiczNV authored Jan 08, 2026
```
Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  6458ef80
- fix(vllmsglang): Give sglang/vllm the HF model name not the full path (#5274) · fcc4a60f
  Graham King authored Jan 08, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fcc4a60f
- fix: prevent services adding/removal in dgd (#5240) · 55c26654
  Julien Mancuso authored Jan 08, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  55c26654
- feat: sglang update to 0.5.7 (#5148) · 92748c93
  ishandhanani authored Jan 08, 2026
  
  92748c93
- chore: remove unused lib/discovery crate (#5266) · 07724eb9
  Neelay Shah authored Jan 07, 2026
```
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  07724eb9
- fix: make node topology immutable in DynamoGraphDeployment (#4969) · 538d3035
  Jonathan Tong authored Jan 08, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
```
  538d3035
- ci: Add post-merge workflow (#4922) · 8b5c8039
  Pavithra Vijayakrishnan authored Jan 07, 2026
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
```
  8b5c8039
07 Jan, 2026 11 commits

revert: remove vLLM backend metrics from planner (#4134) (#5185) · daa1d740
daiyaanarfeen authored Jan 07, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
```
daa1d740
fix: vllm default behaviour for generation prompt (#5223) · b5a6b0db
Ayush Agarwal authored Jan 07, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
b5a6b0db

ci: add workflow to build frontend image (#4285) · 8e3c0d26

Tushar Sharma authored Jan 07, 2026


Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Signed-off-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <harrison.saturley.hall@gmail.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
Signed-off-by: karen-sy <karenc@nvidia.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Jason Zhou <jasonzho@nvidia.com>
Co-authored-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
Co-authored-by: Thomas Montfort <61255722+tmonty12@users.noreply.github.com>
Co-authored-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Tzu-Ling Kan <tzulingk@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Ben Hamm <ben.hamm@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
Co-authored-by: Shuaiyi Zhang <576893949@qq.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Anthony Casagrande <acasagrande@nvidia.com>
Co-authored-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Vladislav Nosivskoy <47858711+vladnosiv@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Kyle McGill <kmcgill@nvidia.com>