Commits · 3e0cb07330f85b793f44b13b634a0d5d348eee48 · OpenDAS / dynamo

"vllm/vscode:/vscode.git/clone" did not exist on "505805b645649be6a8e788a1f048b851fa123ef1"

14 Jul, 2025 8 commits
- fix: copy attributions and license to trtllm runtime container (#1916) · 3e0cb073
  Anant Sharma authored Jul 14, 2025
  
  3e0cb073
- feat: receive kvmetrics from sglang scheduler (#1789) · fc36bf5b
  ishandhanani authored Jul 14, 2025
```
Co-authored-by: zixuanzhang226 <zixuanzhang@bytedance.com>
```
  fc36bf5b
- feat: prefill aware routing (#1895) · df91fce2
  Yan Ru Pei authored Jul 14, 2025
  
  df91fce2
- feat: Shrink the ai-dynamo wheel by 35 MiB (#1918) · ad8ad66b
  Graham King authored Jul 14, 2025
```
Remove http and llmctl binaries. They have been unused for a while.
```
  ad8ad66b
- feat: Python frontend / ingress node (#1912) · 480b41d1
  Graham King authored Jul 14, 2025
  
  480b41d1
- refactor: remove old examples with old UX (#1899) · f00d700e
  Alec authored Jul 14, 2025
  
  f00d700e
- chore: envvars for http paths and live health endpoint (#1846) · c7080419
  Greg Clark authored Jul 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  c7080419
- build: Add support for sglang runtime image (#1770) · 6cdda03b
  Tushar Sharma authored Jul 13, 2025
  
  6cdda03b
12 Jul, 2025 1 commit
- fix: add capi to pip and make it fallback (#1904) · 30e5c35b
  Alec authored Jul 11, 2025
  
  30e5c35b
11 Jul, 2025 5 commits
- feat: add liveness/readiness probes in graph helm chart (#1888) · 35c56065
  julienmancuso authored Jul 11, 2025
  
  35c56065
- chore: update nixl to 0.4.0 release (#1860) (#1886) · d975761b
  Anant Sharma authored Jul 11, 2025
  
  d975761b
- docs: Improve Dynamo Deploy Documentation (#1692) · 57fe1068
  atchernych authored Jul 11, 2025
```
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Julien Mancuso <jmancuso@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  57fe1068
- fix: fall back to 127.0.0.1 if hostname is not available (#1878) · 27c24b3f
  Hongkuan Zhou authored Jul 11, 2025
  
  27c24b3f
- fix: add missing av dependency in contanier for multimodal examples (#1881) · 26d7a61e
  Biswa Panda authored Jul 10, 2025
  
  26d7a61e
10 Jul, 2025 17 commits
- build: Revert "chore: update nixl to 0.4.0 release" (#1880) · 1704b126
  Tushar Sharma authored Jul 10, 2025
  
  1704b126
- feat: allow using ApproxKvIndexer for routing via use_kv_events flag (#1869) · 13640e15
  Yan Ru Pei authored Jul 10, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  13640e15
- perf(tokenizer): Make de-tokenize ~50% faster (#1868) · 61a1f4ff
  Graham King authored Jul 10, 2025
  
  61a1f4ff
- refactor: vllm v1 examples (#1756) · f242b455
  Alec authored Jul 10, 2025
```
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  f242b455
- feat: fix helm chart for graph deployment (#1866) · 3b3d0f2e
  julienmancuso authored Jul 10, 2025
  
  3b3d0f2e
- build: Upgrade nats & etcd version in all containers (#1865) · 7183683e
  Tushar Sharma authored Jul 10, 2025
  
  7183683e
- chore: update nixl to 0.4.0 release (#1860) · 5fa4cdda
  Anant Sharma authored Jul 10, 2025
  
  5fa4cdda
- feat: add hello world deployment example (#1854) · 8cd94119
  Biswa Panda authored Jul 10, 2025
  
  8cd94119
- docs: add docs for profile_sla npz file format (#1859) · fde25fef
  Hongkuan Zhou authored Jul 10, 2025
  
  fde25fef
- fix: prevent null second token output & reduce time to second token l… (#1861) · 382fa2c2
  Ethan-ES authored Jul 11, 2025
```
Co-authored-by: root <root@H20-GPU-24.cm.cluster>
```
  382fa2c2
- fix: KeyError in kv_router.py by Initializing active_blocks_dict for New Workers (#1827) · 83345419
  Umang Kedia authored Jul 10, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  83345419
- fix: add Grafana JSON files back that were accidentally deleted (#1843) · 7ba05754
  Keiven C authored Jul 10, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  7ba05754
- perf(runtime): Use all available parallelism (#1858) · da83f820
  Graham King authored Jul 10, 2025
  
  da83f820
- feat: add multimodal k8s deployment manifest (#1836) · e1ae0f15
  Biswa Panda authored Jul 10, 2025
  
  e1ae0f15
- fix: metrics publishing in vllm v0 worker (#1845) · 39c8d125
  jain-ria authored Jul 09, 2025
  
  39c8d125
- fix: update v1 docs (#1849) · 0f2fa928
  Alec authored Jul 09, 2025
  
  0f2fa928
- feat: update active blocks in chunks only when necessary (#1848) · 5e511e92
  Yan Ru Pei authored Jul 09, 2025
  
  5e511e92
09 Jul, 2025 8 commits
- feat: remove minio dependency (#1833) · 7bc70bc9
  julienmancuso authored Jul 09, 2025
  
  7bc70bc9
- fix: use port 9401 inside and outside of container (#1838) · b0ceb4d3
  Keiven C authored Jul 09, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  b0ceb4d3
- chore: add info about cache flush and bump version (#1839) · 7dea77c3
  ishandhanani authored Jul 09, 2025
  
  7dea77c3
- feat: remove DYN_DEPLOYMENT_CONFIG in examples (#1820) · a604c7f0
  julienmancuso authored Jul 09, 2025
  
  a604c7f0
- chore(cli.py): dynamo-run-in-python handle sglang, vllm and trtllm (#1832) · 93acc631
  Graham King authored Jul 09, 2025
  
  93acc631
- docs: clarify metrics visualization instructions. Removed unused file. (#1824) · e756f390
  Keiven C authored Jul 09, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  e756f390
- feat: Support for unary tool use in ChatCompletions API (#1800) · 5e2f29f5
  Paul Hendricks authored Jul 09, 2025
  
  5e2f29f5
- fix: updating test to not set port (#1823) · 6835dd7a
  Neelay Shah authored Jul 08, 2025
  
  6835dd7a
08 Jul, 2025 1 commit
- feat: Build DistributedRuntime-level HTTP server with /health /metrics (#1656) · ece76a62
  ZichengMa authored Jul 08, 2025
  
  ece76a62