Commits · 98d0ce91b8c7ff0fceefe705a0b308ab158528af · OpenDAS / dynamo

28 Mar, 2026 1 commit
- feat: Support a dynamic default max_tokens for TensorRT-LLM backend (#5152) · 98d0ce91
  Steven Murr authored Mar 27, 2026
```
Signed-off-by: Steven Murr <stevemurr@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  98d0ce91
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
26 Mar, 2026 1 commit
- refactor: load planner using new forwardpass metric and many improvements (#7351) · a58bcc31
  Hongkuan Zhou authored Mar 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a58bcc31
25 Mar, 2026 6 commits
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
- refactor(vllm): scope ray import to scale_elastic_ep, remove module-level ray state (#7618) · 4b8826b3
  Tzu-Ling Kan authored Mar 25, 2026
```
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  4b8826b3
- feat(sglang): disagg DP rank routing + backwards-compatible network imports (#6736) · 7edb07b5
  ishandhanani authored Mar 25, 2026
```
Co-authored-by: huitian bai <baihuitian.bht@gmail.com>
```
  7edb07b5
- fix: strip tools from chat template when tool_choice=none (#7391) · 14a6122e
  Yifan Jiang authored Mar 24, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  14a6122e
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
24 Mar, 2026 3 commits
- feat: remove localhost fallback from NIXL side-channel host detection (#6539) · ee3de9e4
  Alec authored Mar 24, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ee3de9e4
- feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route,... · daa4fb04
  Tzu-Ling Kan authored Mar 24, 2026
```
feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481)
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  daa4fb04
- chore: remove deprecated automatic kv events config for vLLM LLM-94 (#7591) · 115512ef
  Alec authored Mar 23, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  115512ef
23 Mar, 2026 7 commits
- feat(gms): e2e failover support for vLLM (#6818) · 1c65a588
  mohammedabdulwahhab authored Mar 23, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1c65a588
- chore(snapshot): gms + snapshot support (#7026) · b2aefc53
  Janelle Cai authored Mar 23, 2026
```
Signed-off-by: Janelle Cai <jcai18@mit.edu>
```
  b2aefc53
- fix: ProphetPredictor next-step timestamp missing step_size fa… (#7208) · 4159c6fd
  liuhuijiayou authored Mar 24, 2026
```
Signed-off-by: liuhui <liuhui06@kuaishou.com>
Co-authored-by: liuhui <liuhui06@kuaishou.com>
```
  4159c6fd
- fix: vllm forwardpass metric for async scheduling (#7537) · cbdab502
  Hongkuan Zhou authored Mar 23, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cbdab502
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
- fix(snapshot): persist CUDA namespace PIDs in manifest (#7539) · ba9a8a9f
  Schwinn Saereesitthipitak authored Mar 23, 2026
  
  ba9a8a9f
- fix: inherit tool_call_parser and reasoning_parser in LoRA model registration (#7559) · d2d97f18
  Ameen Patel authored Mar 22, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
```
  d2d97f18
21 Mar, 2026 2 commits
- fix: fix MyPy issue introduced in #7517 (#7562) · 725a845f
  Julien Mancuso authored Mar 21, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  725a845f
- refactor: fold SGLang multimodal processor into encode worker (#7517) · 435c8024
  KrishnanPrash authored Mar 20, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  435c8024
20 Mar, 2026 5 commits
- feat(mocker): integrate AIConfigurator for latency prediction (#7505) · 6b67c1c4
  Yongming Ding authored Mar 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6b67c1c4
- feat(mocker): add offline trace replay mode [DYN-2502] (#7543) · c3908a36
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c3908a36
- feat: surface status and errors for profiler in DGDR (#6855) · 740130eb
  Jonathan Tong authored Mar 20, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
```
  740130eb
- feat(llm): unify user-facing priority hints (#7492) · ebd06a1f
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebd06a1f
- feat: [vLLM] add remote embedding loader to prefill/decode worker. Port E/P/D usage (#7507) · 4d302ab6
  GuanLuo authored Mar 19, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  4d302ab6
19 Mar, 2026 5 commits
- feat: enable mypy in pre-merge (#6732) · 2712426f
  jh-nv authored Mar 19, 2026
  
  2712426f
- chore: upgrade tensorrt-llm to 1.3.0rc8 (#7504) · ba3aef8a
  Yuewei Na authored Mar 19, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  ba3aef8a
- fix: change sglang unit tests from gpu_1 to gpu_0 (#7509) · 967ba9a2
  Keiven C authored Mar 19, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  967ba9a2
- feat: add NixlEmbeddingSender / NixlEmbeddingReceiver in sglang backend (#7153) · 70892fc1
  Wang, Yi authored Mar 19, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  70892fc1
- chore: expose inc id and add version to forwardpassmetric (#7501) · 17abc9de
  Hongkuan Zhou authored Mar 18, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  17abc9de
18 Mar, 2026 5 commits
- refactor: [vLLM] Abstract embedding loading to a class. Encapsulate frontend... · 3ccf39e9
  GuanLuo authored Mar 18, 2026
```
refactor: [vLLM] Abstract embedding loading to a class. Encapsulate frontend decoding receiver detail into ImageLoader (#7482)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  3ccf39e9
- refactor: [vLLM] move prefill / decode worker initialization into worker factory (#7367) · 3a925951
  GuanLuo authored Mar 18, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  3a925951
- docs: add mocker under testing (#7488) · 3357c53f
  Yan Ru Pei authored Mar 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3357c53f
- chore: add vllm omni e2e tests (#7454) · f890199f
  Ayush Agarwal authored Mar 18, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  f890199f
- refactor: clean up checkpoint orchestration (#7309) · 38bb9d37
  Schwinn Saereesitthipitak authored Mar 18, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  38bb9d37
17 Mar, 2026 1 commit

feat(mocker): add SGLang engine simulation (#6977) · 930721c8

Yongming Ding authored Mar 17, 2026


Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

930721c8

16 Mar, 2026 2 commits
- feat: vllm omni cli (#6788) · f81f5277
  Ayush Agarwal authored Mar 16, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  f81f5277
- feat: dynamic CLI flags for trtllm (#7335) · 3882cba4
  jh-nv authored Mar 16, 2026
  
  3882cba4
15 Mar, 2026 1 commit
- feat: integrate fastokens BPE tokenizer backend (#7387) · da810a26
  Biswa Panda authored Mar 15, 2026
  
  da810a26