Commits · c8ecc4025fe831c55b6c28eec3352d0586f7268c · OpenDAS / dynamo · GitLab

11 Sep, 2025 2 commits
- ci: fix completions race (#3010) · c8ecc402
  Alec authored Sep 11, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  c8ecc402
- ci: remove not slow filter (#2944) · 1b2826a9
  Alec authored Sep 10, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  1b2826a9
10 Sep, 2025 1 commit

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

09 Sep, 2025 2 commits
- ci: longer timeout, change model for l40 (#2951) · fae35432
  Alec authored Sep 09, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  fae35432
- test: remove nighlty marker in kvbm tests (#2958) · 4a27c02c
  Anant Sharma authored Sep 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  4a27c02c
08 Sep, 2025 1 commit
- refactor: standardize e2e tests across 3 frameworks (#2827) · 93208162
  Alec authored Sep 08, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  93208162
05 Sep, 2025 1 commit
- docs: change docs to default port 8000 (#2876) · 1995ef9a
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1995ef9a
04 Sep, 2025 2 commits
- test: add test for pre-deployment script (#2857) · f72dc01d
  Hongkuan Zhou authored Sep 04, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f72dc01d
- chore: pass in mocker engine args directly in python cli + default frontend port to 8000 (#2853) · 3c7c1d64
  Yan Ru Pei authored Sep 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3c7c1d64
03 Sep, 2025 2 commits
- chore: many bug fixes and improvements when testing planner (#2776) · 7da510cf
  Hongkuan Zhou authored Sep 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: hongkuan <hongkuanz@nvidia.com>
```
  7da510cf
- fix: Remove duplicate import and make logger global. (#2817) · 945a5729
  Tzu-Ling Kan authored Sep 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  945a5729
02 Sep, 2025 4 commits
- feat: Shutdown DRT when vLLM engine fails (#2698) · 432c5b13
  J Wyman authored Sep 02, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
```
  432c5b13
- build: enable kvbm in vllm container (#2763) · 316e8844
  Anant Sharma authored Sep 02, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  316e8844
- refactor: Rewrite test_metrics_labels to use TRTLLMProcess. (#2794) · d83854b5
  Tzu-Ling Kan authored Sep 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d83854b5
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 4 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- feat: DIS-373 dynamo KVBM connector API integration with TRTLLM (#2544) · a68c2f8f
  Richard Huo authored Aug 29, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  a68c2f8f
- feat: add logits processor support for trtllm backend (#2702) · 43a26958
  Bhuvan Agrawal authored Aug 29, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  43a26958
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
29 Aug, 2025 3 commits
- fix: Remove duplicate import and update the test comment. (#2784) · ea7a9236
  Tzu-Ling Kan authored Aug 29, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  ea7a9236
- test: add tests for replica calculation and planner scaling (#2525) · 353ba5db
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  353ba5db
- fix: [trtllm] add wait_for_instance before register_llm (#2683) · 8c2072cf
  Alec authored Aug 28, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  8c2072cf
28 Aug, 2025 3 commits
- feat: Prevent double-tokenization when EPP picks worker (#2559) · 7d13b6e3
  atchernych authored Aug 28, 2025
  
  7d13b6e3
- ci: add support for vllm sanity testing on Github (#2526) · 82bae247
  Anant Sharma authored Aug 28, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  82bae247
- feat: Add vLLM multimodal video support (#2738) · 78a11074
  Kris Hung authored Aug 27, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  78a11074
27 Aug, 2025 2 commits
- feat: Sglang metrics labels. (#2679) · bad5d122
  Tzu-Ling Kan authored Aug 27, 2025
  
  bad5d122
- feat: Trtllm metric_labels. (#2666) · ef535edb
  Tzu-Ling Kan authored Aug 26, 2025
  
  ef535edb
26 Aug, 2025 1 commit
- feat: Add vllm multimodal qwen aggregated support (#2694) · 50cd81f3
  Kris Hung authored Aug 26, 2025
  
  50cd81f3
25 Aug, 2025 2 commits
- feat: python bindings for the entire KvPushRouter + per-request router configs (#2658) · f08729ae
  Yan Ru Pei authored Aug 25, 2025
  
  f08729ae
- fix: correct planner test example after tokenizer fix (#2674) · 35055c6f
  Hongkuan Zhou authored Aug 25, 2025
  
  35055c6f
24 Aug, 2025 1 commit
- fix: pytest robustness and parsing error (#2676) · 9b9f2ce4
  Alec authored Aug 24, 2025
  
  9b9f2ce4
22 Aug, 2025 2 commits
- fix: Update pytest markers for deepep test. (#2561) · f2089d2e
  Kris Hung authored Aug 22, 2025
  
  f2089d2e
- fix: set functional tests to use qwen (#2617) · e2e909f3
  ishandhanani authored Aug 21, 2025
  
  e2e909f3
21 Aug, 2025 2 commits
- test: Temporary exclude kvbm tests from vllm, nightly, gpu1... (#2611) · 88d953bf
  Olga Andreeva authored Aug 21, 2025
  
  88d953bf
- feat: register Kv router instance into etcd (#2548) · ab9c9509
  Yan Ru Pei authored Aug 21, 2025
  
  ab9c9509
20 Aug, 2025 3 commits
- fix: Increase timeout for deepep test (#2572) · 11bc8a17
  Kris Hung authored Aug 20, 2025
  
  11bc8a17
- test: add dryrun mode for sla planner (#2557) · 1b3a1073
  Hongkuan Zhou authored Aug 20, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  1b3a1073
- test: Add deepep test for vllm (#2534) · 536280fc
  Kris Hung authored Aug 19, 2025
  
  536280fc
19 Aug, 2025 1 commit
- feat: Rename dynamo_component_concurrent_requests (#2515) · 6f7f6b12
  Tzu-Ling Kan authored Aug 19, 2025
```
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  6f7f6b12