Commits · bbe8dbb22d346358d4fd5876dd84539888d40b0d · OpenDAS / dynamo

25 Jul, 2025 1 commit
- fix: move docker-compose.yml to deploy/, and update frontend port (#2121) · 4498a77d
  Keiven C authored Jul 25, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  4498a77d
16 Jul, 2025 1 commit
- refactor: Move TRTLLM example to the component/backends (#1976) · 4ad281f2
  Tanmay Verma authored Jul 16, 2025
  
  4ad281f2
15 Jul, 2025 1 commit
- refactor: Refactor the TRTLLM examples remove dynamo SDK (#1884) · 901715b5
  Tanmay Verma authored Jul 14, 2025
  
  901715b5
14 Jul, 2025 1 commit

docs: TRTLLM Example of Llama4+Eagle3 (Speculative Decoding) (#1828) · ef59ac8d

KrishnanPrash authored Jul 14, 2025


Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Iman Tabrizian <10105175+Tabrizian@users.noreply.github.com>

ef59ac8d

26 Jun, 2025 1 commit
- refactor: Refactor the TRTLLM example components and improve UI (#1654) · 03d976c7
  Tanmay Verma authored Jun 26, 2025
```
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
```
  03d976c7
25 Jun, 2025 1 commit
- fix: Disable NIXL backend for TRTLLM on ARM (#1639) · e84b1e77
  Tanmay Verma authored Jun 25, 2025
  
  e84b1e77
24 Jun, 2025 1 commit
- feat: Using NIXL for KV cache transfer when using disaggregated serving in TRTLLM (#1591) · 0b7cdf55
  Tanmay Verma authored Jun 24, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0b7cdf55
16 Jun, 2025 1 commit
- build: DIS-148 use the tensorrt_llm public wheel from pypi by default in container build (#1525) · 47d05d7a
  richardhuo-nv authored Jun 16, 2025
  
  47d05d7a
13 Jun, 2025 1 commit
- docs: Add multi-node TRTLLM worker example (Deepseek R1) (#1511) · 40ca062f
  Ryan McCormick authored Jun 14, 2025
  
  40ca062f
12 Jun, 2025 1 commit
- docs: fix the README link to the perf.sh file (#1501) · 0bba09a4
  richardhuo-nv authored Jun 12, 2025
  
  0bba09a4
11 Jun, 2025 3 commits
- docs: Add note about ignore_eos for MTP (#1475) · 150e983a
  Ryan McCormick authored Jun 12, 2025
  
  150e983a
- docs: MTP + TensorRT LLM + DS R1 disaggregated example (#1473) · 3363d8b6
  richardhuo-nv authored Jun 11, 2025
  
  3363d8b6
- docs: add message to guide users to the stable version (#1457) · e32fe675
  richardhuo-nv authored Jun 11, 2025
  
  e32fe675
07 Jun, 2025 2 commits
- docs: Reference Deepseek R1 configs in TRTLLM README (#1414) · 9281c95f
  Ryan McCormick authored Jun 08, 2025
  
  9281c95f
- docs: add aggregated example turning on MTP with DeepSeek R1 (#1421) · 4de7f44c
  richardhuo-nv authored Jun 06, 2025
  
  4de7f44c
27 May, 2025 1 commit
- docs: fix minor typo (#1206) · a8bdc0be
  Akash authored May 28, 2025
```
Signed-off-by: Akash <akpaul@nvidia.com>
```
  a8bdc0be
08 May, 2025 1 commit
- docs: Add slurm env var workaround for MPI spawn errors (#992) · 57402e70
  Ryan McCormick authored May 08, 2025
  
  57402e70
07 May, 2025 1 commit

build: Cleans the TensorRTLLM + Dynamo container build (#968) · 7dd79013

Tanmay Verma authored May 07, 2025


Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

7dd79013

06 May, 2025 1 commit
- refactor: refactor dynamo deploy subfolder (#927) · 403344e5
  hhzhang16 authored May 06, 2025
  
  403344e5
02 May, 2025 2 commits
- feat: Update to support completion endpoint in TRTLLM (#837) · 960ee927
  Tanmay Verma authored May 02, 2025
  
  960ee927
- docs: Add multi-node TRTLLM steps to README (#930) · f0ac8e2b
  Ryan McCormick authored May 02, 2025
  
  f0ac8e2b
01 May, 2025 1 commit
- fix: add dedicated llmapi config for trtllm disagg kv routing example (#916) · 0086ebc6
  Ziqi Fan authored Apr 30, 2025
  
  0086ebc6
29 Apr, 2025 1 commit

refactor: change trtllm example kv routing use python bindings | deal with... · 3c1c2ac3

Ziqi Fan authored Apr 28, 2025

refactor: change trtllm example kv routing use python bindings | deal with trtllm partial blocks | trtllm event change (#866)

3c1c2ac3

28 Apr, 2025 1 commit
- feat: Add unified x86 / aarch64 (ARM) build for VLLM image (#839) · 566068dc
  Ryan McCormick authored Apr 28, 2025
  
  566068dc
24 Apr, 2025 1 commit
- fix: Update TRTLLM version and fix disagg workflow (#804) · 197105eb
  Tanmay Verma authored Apr 23, 2025
  
  197105eb
11 Apr, 2025 3 commits
- docs: Add documentation for UCX KV cache transfer in TRTLLM (#639) · 8d35dc43
  Tanmay Verma authored Apr 11, 2025
  
  8d35dc43
- docs: Add instructions to install git lfs (#627) · ee986548
  Tanmay Verma authored Apr 11, 2025
  
  ee986548
- feat: TRT-LLM disaggregated serving using UCX (#562) · da38e96a
  Tanmay Verma authored Apr 10, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  da38e96a
09 Apr, 2025 1 commit
- docs: Move trtllm dynamo run doc from example to dynamo run guide (#578) · 0186aa7b
  Tanmay Verma authored Apr 09, 2025
  
  0186aa7b
07 Apr, 2025 1 commit
- docs: update close-deployment in dynamo_serve.md (#535) · df54b9cb
  tlipoca9 authored Apr 08, 2025
```
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  df54b9cb
04 Apr, 2025 1 commit
- fix: broken link to dynamo run (#517) · bd8f0804
  Kyungmin Lee authored Apr 04, 2025
  
  bd8f0804
03 Apr, 2025 1 commit
- feat: Add TensorRT-LLM example for dynamo serve/run (#456) · 6eb10540
  Tanmay Verma authored Apr 03, 2025
```
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  6eb10540