Commits · 89e7dab2ac91dabbf8eeb9ee1cbb21ee8b083ada · OpenDAS / dynamo

"examples/backends/trtllm/vscode:/vscode.git/clone" did not exist on "c3984bc2d73cdaebf7d1f41e95544abdbb56b39c"

07 Oct, 2025 4 commits
- chore: add e2e test for reasoning_effort for gpt-oss model (#3421) · 89e7dab2
  zhongdaor-nv authored Oct 07, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  89e7dab2
- ci: Adding Unit Tests for vLLM (--custom-jinja-template) (#3362) · ff625465
  KrishnanPrash authored Oct 07, 2025
  
  ff625465
- chore: Clean up for sglang multimodal example (#3420) · ddbb4f50
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  ddbb4f50
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
06 Oct, 2025 5 commits
- test: Remove timing dependency on E2E cancellation tests (#3391) · 4d48fe67
  Jacky authored Oct 06, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  4d48fe67
- feat: Add legacy client along with aiperf for FT tests (#3415) · f414bc5a
  Indrajit Bhosale authored Oct 06, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  f414bc5a
- test: Add per-worker routing and KV event synchronization test + minor... · 2160b913
  Paul Li authored Oct 06, 2025
```
test: Add per-worker routing and KV event synchronization test + minor subscriber worker_id parsing fix (#3426)
Signed-off-by: Paul Li <zhixiong2008@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2160b913
- feat: time parsing logic (#3412) · 36116d7f
  Tzu-Ling Kan authored Oct 06, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  36116d7f
- fix: Fix vllm multimodal tests (#3361) · 069434b4
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  069434b4
05 Oct, 2025 1 commit

test: Update the test guideline (#3377) · ede0da16

Pavithra Vijayakrishnan authored Oct 05, 2025


Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

ede0da16

03 Oct, 2025 2 commits
- test: Simplify test_indexers_sync() with the new helper send_request_via_python_kv_router() (#3339) · e7a73cb1
  Paul Li authored Oct 03, 2025
```
Signed-off-by: Paul Li <zhixiong2008@gmail.com>
```
  e7a73cb1
- test: TRTLLM K8s FT tests (#3368) · 031dc589
  Indrajit Bhosale authored Oct 02, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  031dc589
02 Oct, 2025 2 commits
- docs: Fix broken links (#3372) · e8cfbd7d
  Ryan McCormick authored Oct 02, 2025
  
  e8cfbd7d
- feat: Add multimodal EPD for Sglang (#3230) · 62661cce
  Kris Hung authored Oct 01, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  62661cce
01 Oct, 2025 2 commits
- feat: restructure source code for python packaging (#3201) · 836d7417
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  836d7417
- feat: Using ai-perf for k8 FT tests. (#3289) · 02c822d6
  Tzu-Ling Kan authored Sep 30, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  02c822d6
30 Sep, 2025 4 commits

feat: Add --custom-jinja-template argument to pass a custom chat template for SGLang (#3165) · f95ba894

KrishnanPrash authored Sep 30, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

f95ba894

feat: add Python const for Prometheus metric names (#3244) · cacac9b9
Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
cacac9b9

test: create a helper function to send request directly to mocker instances (#3269) · 74a56676

Paul Li authored Sep 29, 2025


Signed-off-by: Paul Li <zhixiong2008@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

74a56676

test: Allow prefill cancellation tests to fail (#3300) · 44a40a0b
Jacky authored Sep 29, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
44a40a0b

29 Sep, 2025 1 commit

feat: add subComponentType in DGD API and uptake in planner (#3200) · 1a5016b0

Thomas Montfort authored Sep 29, 2025


Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>

1a5016b0

26 Sep, 2025 3 commits
- feat: Add sglang k8 FT tests (#3227) · ec50db06
  Tzu-Ling Kan authored Sep 26, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  ec50db06
- feat: Request Cancellation TRT-LLM (#3193) · 77e66ae5
  Jacky authored Sep 26, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  77e66ae5
- chore: Remove etcd from python bindings (#3238) · 7ebbd001
  Graham King authored Sep 26, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7ebbd001
24 Sep, 2025 5 commits
- fix: update the tags for consistency and remove 0.4.1 refs (#3058) · 9e8f67ed
  Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9e8f67ed
- test: fault injection tests for k8s (#3194) · 52c75363
  Tzu-Ling Kan authored Sep 24, 2025
```
Signed-off-by: nnshah1 <neelays@nvidia.com>
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Co-authored-by: nnshah1 <neelays@nvidia.com>
```
  52c75363
- feat: update planner manifests for Grove support (#3203) · 8bc2191e
  Thomas Montfort authored Sep 24, 2025
  
  8bc2191e
- build: enable kvbm in trtllm container (#2956) · 70f99382
  Anant Sharma authored Sep 24, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  70f99382
- feat: support MoE model in SLA Planner Sglang (#3185) · 6243bcbe
  Hongkuan Zhou authored Sep 23, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  6243bcbe
23 Sep, 2025 1 commit
- feat: Enable vLLM abort while engine is generating the next token (#3102) · 8bb9a555
  Jacky authored Sep 23, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  8bb9a555
19 Sep, 2025 3 commits

feat: Add --use-ai-configurator to profile_sla.py (#3079) · 19948b7f

Ilya Sherstyuk authored Sep 19, 2025


Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

19948b7f

feat: KVBM connector : enabling vectorized copy from pinned memory to device... · 2d39f1b1

Olga Andreeva authored Sep 19, 2025

feat: KVBM connector : enabling vectorized copy from pinned memory to device memory and vice versa (#2989)
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>

2d39f1b1

feat: Request Cancellation unary request support (#3004) · a8fd1271
Jacky authored Sep 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
a8fd1271

18 Sep, 2025 2 commits
- fix: add prometheus_client to dep instead of transitive dependency (#3083) · c34f945b
  Hongkuan Zhou authored Sep 18, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  c34f945b
- chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
  Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b6595e24
17 Sep, 2025 2 commits
- fix: fix some trtllm tests (#3084) · 002617a9
  Richard Huo authored Sep 17, 2025
  
  002617a9
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1
16 Sep, 2025 3 commits
- feat: update directory structure in script and simplify planner scaling test (#3049) · 65fa037d
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  65fa037d
- chore: moved asyncio import to top of the file for planner test (#3001) · fa6feee4
  Michael Shin authored Sep 16, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fa6feee4
- test: update planner docs with requirements that are needed; point users to... · 895fb216
  hhzhang16 authored Sep 16, 2025
```
test: update planner docs with requirements that are needed; point users to readme for installation (#3032)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  895fb216