Commits · 5bf23d54f3e46a15ff5000773a32d8829befa919 · OpenDAS / dynamo

10 Jul, 2025 1 commit
- fix: prevent null second token output & reduce time to second token l… (#1861) · 382fa2c2
  Ethan-ES authored Jul 11, 2025
```
Co-authored-by: root <root@H20-GPU-24.cm.cluster>
```
  382fa2c2
02 Jul, 2025 1 commit
- fix: Add handling for ignore_eos sampling param in trtllm example base engine (#1726) · 008bb1e6
  Indrajit Bhosale authored Jul 02, 2025
  
  008bb1e6
27 Jun, 2025 1 commit
- fix: fix the if statement for checking tllm_disagg_params.opaque_state is none (#1679) · 96cc0698
  richardhuo-nv authored Jun 27, 2025
  
  96cc0698
26 Jun, 2025 2 commits
- refactor: Refactor the TRTLLM example components and improve UI (#1654) · 03d976c7
  Tanmay Verma authored Jun 26, 2025
```
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
```
  03d976c7
- feat: Add experimental WideEP + EPLB aggregated example for TRTLLM (#1652) · 5fe5a950
  Ryan McCormick authored Jun 27, 2025
  
  5fe5a950
05 Jun, 2025 1 commit
- fix: Use Rust Ingress (dynamo-run) for the Frontend (#1391) · 568eb100
  Tanmay Verma authored Jun 04, 2025
  
  568eb100
04 Jun, 2025 2 commits
- feat: decouple bento dependency (#1266) · afb8495e
  Biswa Panda authored Jun 04, 2025
  
  afb8495e
- fix: add speculative decoding config to dynamo serve + trtllm (#1356) · 5c9a2d49
  richardhuo-nv authored Jun 04, 2025
  
  5c9a2d49
30 May, 2025 2 commits
- refactor: rename KvMetricsPublisher to WorkerMetricsPublisher (#1284) · 2f8da9ad
  Alec authored May 30, 2025
  
  2f8da9ad
- fix: Fix mypy errors on trtllm examples (#1277) · 003c4270
  Tanmay Verma authored May 29, 2025
  
  003c4270
21 May, 2025 1 commit
- fix: Fix the protocol in the example (#1146) · 84377e5d
  Tanmay Verma authored May 21, 2025
  
  84377e5d
20 May, 2025 1 commit
- fix: Incrementally decode token to reduce the overhead from Processor (#1129) · b3da9427
  Tanmay Verma authored May 20, 2025
  
  b3da9427
07 May, 2025 1 commit

build: Cleans the TensorRTLLM + Dynamo container build (#968) · 7dd79013

Tanmay Verma authored May 07, 2025


Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

7dd79013

02 May, 2025 1 commit
- feat: Update to support completion endpoint in TRTLLM (#837) · 960ee927
  Tanmay Verma authored May 02, 2025
  
  960ee927
01 May, 2025 1 commit
- fix: add dedicated llmapi config for trtllm disagg kv routing example (#916) · 0086ebc6
  Ziqi Fan authored Apr 30, 2025
  
  0086ebc6
29 Apr, 2025 1 commit

refactor: change trtllm example kv routing use python bindings | deal with... · 3c1c2ac3

Ziqi Fan authored Apr 28, 2025

refactor: change trtllm example kv routing use python bindings | deal with trtllm partial blocks | trtllm event change (#866)

3c1c2ac3

24 Apr, 2025 1 commit
- fix: Update TRTLLM version and fix disagg workflow (#804) · 197105eb
  Tanmay Verma authored Apr 23, 2025
  
  197105eb
15 Apr, 2025 1 commit
- fix: set correct parent_hash for each kv block when publish kv events (#671) · 15455dff
  Ziqi Fan authored Apr 14, 2025
  
  15455dff
11 Apr, 2025 1 commit

feat: TRT-LLM disaggregated serving using UCX (#562) · da38e96a

Tanmay Verma authored Apr 10, 2025


Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

da38e96a

08 Apr, 2025 1 commit

chore: Update TRTLLM version. Fix router. (#527) · 7dca64df

Tanmay Verma authored Apr 07, 2025


Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>

7dca64df

07 Apr, 2025 1 commit
- fix: mypy error (#543) · 6eb31507
  ishandhanani authored Apr 07, 2025
```
Co-authored-by: finofliu <finofliu@tencent.com>
```
  6eb31507
03 Apr, 2025 1 commit
- feat: Add TensorRT-LLM example for dynamo serve/run (#456) · 6eb10540
  Tanmay Verma authored Apr 03, 2025
```
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  6eb10540