Commits · 76fd47165cafcdd0bbdd58e2e37d54249dbae1d0 · OpenDAS / dynamo

22 Jul, 2025 1 commit
- refactor: support for turning prefix cache off (#2034) · 76fd4716
  Alec authored Jul 21, 2025
  
  76fd4716
21 Jul, 2025 1 commit
- fix: mypy error (#2029) · d4b5414a
  atchernych authored Jul 21, 2025
  
  d4b5414a
19 Jul, 2025 1 commit
- fix: Revert "feat: add vLLM v1 multi-modal example. Add llama4 Maverick ex… (#2017) · fe63c17a
  Alec authored Jul 18, 2025
  
  fe63c17a
18 Jul, 2025 1 commit
- feat: add vLLM v1 multi-modal example. Add llama4 Maverick example (#1990) · 353146e2
  GuanLuo authored Jul 18, 2025
```
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: krishung5 <krish@nvidia.com>
```
  353146e2
17 Jul, 2025 3 commits
- chore: update cmake and gap installation and sgl in wideep container (#1991) · b8474e54
  ishandhanani authored Jul 17, 2025
  
  b8474e54
- refactor: replace vllm with vllm_v1 container (#1953) · 6d2be143
  Biswa Panda authored Jul 17, 2025
```
Co-authored-by: alec-flowers <aflowers@nvidia.com>
```
  6d2be143
- chore: add port reservation to utils (#1980) · 4d2a31ab
  ishandhanani authored Jul 16, 2025
  
  4d2a31ab
16 Jul, 2025 3 commits
- fix: port race condition through deterministic ports (#1937) · 1e3e4a0c
  Alec authored Jul 16, 2025
  
  1e3e4a0c
- refactor: Move TRTLLM example to the component/backends (#1976) · 4ad281f2
  Tanmay Verma authored Jul 16, 2025
  
  4ad281f2
- fix: vllm router examples (#1942) · 7b325ee8
  Biswa Panda authored Jul 15, 2025
  
  7b325ee8
15 Jul, 2025 7 commits
- chore: Move examples/cli to lib/bindings/examples/cli (#1952) · 7b9182fd
  Graham King authored Jul 15, 2025
  
  7b9182fd
- chore(multi-modal): Rename frontend.py to web.py (#1951) · 40d40dda
  Graham King authored Jul 15, 2025
  
  40d40dda
- feat: configurable namespace for vllm v1 example (#1909) · fc402a35
  Biswa Panda authored Jul 14, 2025
  
  fc402a35
- docs: fix typo and add mount-workspace to vllm doc (#1931) · df40d2ca
  ZichengMa authored Jul 14, 2025
```
Signed-off-by: ZichengMa <zichengma1225@gmail.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  df40d2ca
- refactor: Refactor the TRTLLM examples remove dynamo SDK (#1884) · 901715b5
  Tanmay Verma authored Jul 14, 2025
  
  901715b5
- feat: update DynamoGraphDeployments for vllm_v1 (#1890) · 5bf23d54
  hhzhang16 authored Jul 14, 2025
```
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  5bf23d54
- docs: organize sglang readme (#1910) · 9e76590f
  ishandhanani authored Jul 14, 2025
  
  9e76590f
14 Jul, 2025 3 commits
- docs: TRTLLM Example of Llama4+Eagle3 (Speculative Decoding) (#1828) · ef59ac8d
  KrishnanPrash authored Jul 14, 2025
```
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Iman Tabrizian <10105175+Tabrizian@users.noreply.github.com>
```
  ef59ac8d
- feat: receive kvmetrics from sglang scheduler (#1789) · fc36bf5b
  ishandhanani authored Jul 14, 2025
```
Co-authored-by: zixuanzhang226 <zixuanzhang@bytedance.com>
```
  fc36bf5b
- refactor: remove old examples with old UX (#1899) · f00d700e
  Alec authored Jul 14, 2025
  
  f00d700e
11 Jul, 2025 3 commits
- docs: Improve Dynamo Deploy Documentation (#1692) · 57fe1068
  atchernych authored Jul 11, 2025
```
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Julien Mancuso <jmancuso@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  57fe1068
- fix: fall back to 127.0.0.1 if hostname is not available (#1878) · 27c24b3f
  Hongkuan Zhou authored Jul 11, 2025
  
  27c24b3f
- fix: add missing av dependency in contanier for multimodal examples (#1881) · 26d7a61e
  Biswa Panda authored Jul 10, 2025
  
  26d7a61e
10 Jul, 2025 7 commits
- refactor: vllm v1 examples (#1756) · f242b455
  Alec authored Jul 10, 2025
```
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  f242b455
- feat: add hello world deployment example (#1854) · 8cd94119
  Biswa Panda authored Jul 10, 2025
  
  8cd94119
- fix: prevent null second token output & reduce time to second token l… (#1861) · 382fa2c2
  Ethan-ES authored Jul 11, 2025
```
Co-authored-by: root <root@H20-GPU-24.cm.cluster>
```
  382fa2c2
- fix: KeyError in kv_router.py by Initializing active_blocks_dict for New Workers (#1827) · 83345419
  Umang Kedia authored Jul 10, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  83345419
- feat: add multimodal k8s deployment manifest (#1836) · e1ae0f15
  Biswa Panda authored Jul 10, 2025
  
  e1ae0f15
- fix: metrics publishing in vllm v0 worker (#1845) · 39c8d125
  jain-ria authored Jul 09, 2025
  
  39c8d125
- fix: update v1 docs (#1849) · 0f2fa928
  Alec authored Jul 09, 2025
  
  0f2fa928
09 Jul, 2025 3 commits
- chore: add info about cache flush and bump version (#1839) · 7dea77c3
  ishandhanani authored Jul 09, 2025
  
  7dea77c3
- feat: remove DYN_DEPLOYMENT_CONFIG in examples (#1820) · a604c7f0
  julienmancuso authored Jul 09, 2025
  
  a604c7f0
- chore(cli.py): dynamo-run-in-python handle sglang, vllm and trtllm (#1832) · 93acc631
  Graham King authored Jul 09, 2025
  
  93acc631
08 Jul, 2025 6 commits
- feat(python): Python bindings for the Dynamo CLI tools (#1799) · 2bf27924
  Graham King authored Jul 08, 2025
  
  2bf27924
- fix: Update docker-compose.yml path for examples/llm/benchmarks (#1816) · c5f5dd2d
  Jacky authored Jul 08, 2025
  
  c5f5dd2d
- chore: multinode dsr1 doc fix (#1814) · 330e649c
  ishandhanani authored Jul 08, 2025
  
  330e649c
- feat: undo coderabbit requested changes (#1813) · 427d5471
  hhzhang16 authored Jul 08, 2025
  
  427d5471
- fix: fix gpu resource spec in llm deployments (#1812) · c183aa31
  Biswa Panda authored Jul 08, 2025
  
  c183aa31
- feat: remove dynamo deployment from cli (#1742) · fbd1f8df
  Biswa Panda authored Jul 08, 2025
  
  fbd1f8df
07 Jul, 2025 1 commit

feat: add crds for vllm and llm examples (#1766) · 5505507b

mohammedabdulwahhab authored Jul 07, 2025


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

5505507b