Commits · 6f7f6b12df9e892987cee48926609efb6faab169 · OpenDAS / dynamo

"tests/vscode:/vscode.git/clone" did not exist on "bff78310d979bf516b45d8908b5e621a170578b9"

19 Aug, 2025 7 commits
- docs: Add note for LMCache ARM support (#2535) · b9cbee0b
  ZichengMa authored Aug 19, 2025
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  b9cbee0b
- chore: Finish vllm upgrade to 0.10.1 + cleanup (#2528) · 5f57ea5f
  Dmitry Tokarev authored Aug 19, 2025
  
  5f57ea5f
- docs: Consolidate documentation and fix redundant headings (#2518) · 129a2444
  Anish authored Aug 19, 2025
  
  129a2444
- feat: add a knob to turn off correction factor in sla planner (#2511) · d9aef67e
  Hongkuan Zhou authored Aug 19, 2025
  
  d9aef67e
- feat(frontend): support setting HTTP host via CLI (--http-host) (#2523) · c5d9d267
  suzu authored Aug 19, 2025
  
  c5d9d267
- feat: router-level request rejection (#2465) · 85d83108
  Yan Ru Pei authored Aug 19, 2025
  
  85d83108
- feat(sglang): unify entry point for SGLang backend architecture (#2493) · 80d8aa19
  ishandhanani authored Aug 18, 2025
  
  80d8aa19
18 Aug, 2025 6 commits
- test: add unit test for sla planner's interpolator (#2505) · 0376e72f
  Hongkuan Zhou authored Aug 18, 2025
  
  0376e72f
- fix: set frontend defaults (#2484) · 28546bad
  mohammedabdulwahhab authored Aug 18, 2025
  
  28546bad
- fix: do not set default for resources (#2471) · 56e99232
  julienmancuso authored Aug 18, 2025
  
  56e99232
- feat(http): TLS support (#2492) · a4bbe492
  Graham King authored Aug 18, 2025
  
  a4bbe492
- chore: add pre-deployment profiling results on H200 cluster to unblock planner testing (#2495) · dea0b201
  Hongkuan Zhou authored Aug 18, 2025
```
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
```
  dea0b201
- docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add... · 844f8819
  Ryan McCormick authored Aug 18, 2025
```
docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add lychee link checker github action (#2482)
```
  844f8819
16 Aug, 2025 2 commits
- docs: Add LMCache in vLLM README.md (#2462) · fb10ffb5
  ZichengMa authored Aug 15, 2025
```
Signed-off-by: ZichengMa <zichengma1225@gmail.com>
```
  fb10ffb5
- fix: revert registering runtime config for trtllm backend (deadlock) (#2464) · eaf42eb0
  Yan Ru Pei authored Aug 15, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  eaf42eb0
15 Aug, 2025 8 commits
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
- chore(sglang): Warn if --skip-tokenizer-init missing (#2463) · 57454300
  Graham King authored Aug 15, 2025
  
  57454300
- fix: fix examples (#2459) · a4e06895
  julienmancuso authored Aug 15, 2025
  
  a4e06895
- feat: Support `python -m dynamo.frontend --version` (#2449) · ccc8c627
  Graham King authored Aug 15, 2025
  
  ccc8c627
- fix: remove add_labels in Component (#2458) · 24a935e5
  Keiven C authored Aug 15, 2025
  
  24a935e5
- feat: extract deploymentType as interface (#2405) · 72128596
  julienmancuso authored Aug 15, 2025
  
  72128596
- feat(metrics): add NATS client metrics to prometheus_metrics_fmt (#2292) · acbdabc4
  Keiven C authored Aug 14, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  acbdabc4
- chore: Rename tensorrtllm framework to trtllm (#2435) · a3d624a7
  Tanmay Verma authored Aug 14, 2025
  
  a3d624a7
14 Aug, 2025 5 commits
- fix: operator defaults (#2398) · 81c27803
  mohammedabdulwahhab authored Aug 14, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  81c27803
- feat: Add a "model" label to Component metrics (#2389) · 3a3f5bf2
  Tzu-Ling Kan authored Aug 14, 2025
  
  3a3f5bf2
- feat: add RuntimeConfig to ModelEntry (#2311) · d0a63635
  Jorge António authored Aug 14, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  d0a63635
- fix: add instruction to deploy model with inference gateway (#2257) · b74b887b
  Biswa Panda authored Aug 14, 2025
  
  b74b887b
- fix: Update gpt-oss.md w/ HF CLI pip install (#2431) · 20ad730c
  Anish authored Aug 13, 2025
```
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  20ad730c
13 Aug, 2025 7 commits
- fix(ci): Reduce the free gpu memory fraction (#2433) · f6fef485
  Tanmay Verma authored Aug 13, 2025
  
  f6fef485
- feat: Add vars to multi-node trtllm slurm scripts to support xP yD deployments (#2429) · cebe9219
  Ryan McCormick authored Aug 13, 2025
  
  cebe9219
- feat: enable custom metrics prefix (#2432) · 3411bda8
  ryan-lempka authored Aug 13, 2025
  
  3411bda8
- test: add kv routing test for sglang (#2424) · c0ed76da
  ishandhanani authored Aug 13, 2025
```
Signed-off-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  c0ed76da
- feat: Allow an endpoint to serve multiple models (#2418) · 72ec5f5c
  Graham King authored Aug 13, 2025
  
  72ec5f5c
- chore: update wideep dockerfile for sgl to newest rel (#2422) · ebc84d6c
  ishandhanani authored Aug 12, 2025
  
  ebc84d6c
- feat: support sglang in sla planner (#2421) · e22f84ab
  Hongkuan Zhou authored Aug 12, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  e22f84ab
12 Aug, 2025 2 commits
- feat: Add performance sweeps for DeepSeek R1 on GB200 (#2387) · 1327e3bb
  Tanmay Verma authored Aug 12, 2025
  
  1327e3bb
- feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68
  Hongkuan Zhou authored Aug 12, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  b4189c68
11 Aug, 2025 3 commits
- docs: add sglang installation variants (#2400) · d51580a4
  ishandhanani authored Aug 11, 2025
  
  d51580a4
- fix: use default batch_size for decode (#2376) · 43854732
  Neal Vaidya authored Aug 10, 2025
  
  43854732
- docs: add sglang hicache example and guide (#2388) · 3b722842
  Faradawn Yang authored Aug 10, 2025
  
  3b722842