Commits · 4eb25632227fde44b2f510fdaa411539b083218e · OpenDAS / dynamo · GitLab

21 Aug, 2025 2 commits
- feat: use consistent small models across all deploy examples (#2573) · 4eb25632
  Biswa Panda authored Aug 20, 2025
  
  4eb25632
- docs: change sglang hicache example to use hicache-ratio (#2582) · 26b3b609
  Ziqi Fan authored Aug 20, 2025
  
  26b3b609
20 Aug, 2025 5 commits
- feat: allow user to adjust kv_transfer_config (#2517) · bc290e7c
  Alec authored Aug 20, 2025
  
  bc290e7c
- feat(sglang): allow for multi worker spin up in slurm scripts (#2328) · e31c8790
  ishandhanani authored Aug 20, 2025
  
  e31c8790
- fix: resources in wrong location in vllm disag_router example (#2558) · 539c18cd
  julienmancuso authored Aug 20, 2025
  
  539c18cd
- docs: Add health check section to GPT OSS guide (#2556) · 8380f1bd
  Ryan McCormick authored Aug 20, 2025
  
  8380f1bd
- test: Add deepep test for vllm (#2534) · 536280fc
  Kris Hung authored Aug 19, 2025
  
  536280fc
19 Aug, 2025 5 commits
- feat: Use health check and improve instructions for perf sweeps (#2423) · 86a4a58e
  Tanmay Verma authored Aug 19, 2025
  
  86a4a58e
- docs: Add note for LMCache ARM support (#2535) · b9cbee0b
  ZichengMa authored Aug 19, 2025
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  b9cbee0b
- chore: Finish vllm upgrade to 0.10.1 + cleanup (#2528) · 5f57ea5f
  Dmitry Tokarev authored Aug 19, 2025
  
  5f57ea5f
- docs: Consolidate documentation and fix redundant headings (#2518) · 129a2444
  Anish authored Aug 19, 2025
  
  129a2444
- feat(sglang): unify entry point for SGLang backend architecture (#2493) · 80d8aa19
  ishandhanani authored Aug 18, 2025
  
  80d8aa19
18 Aug, 2025 4 commits
- fix: set frontend defaults (#2484) · 28546bad
  mohammedabdulwahhab authored Aug 18, 2025
  
  28546bad
- fix: do not set default for resources (#2471) · 56e99232
  julienmancuso authored Aug 18, 2025
  
  56e99232
- chore: add pre-deployment profiling results on H200 cluster to unblock planner testing (#2495) · dea0b201
  Hongkuan Zhou authored Aug 18, 2025
```
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
```
  dea0b201
- docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add... · 844f8819
  Ryan McCormick authored Aug 18, 2025
```
docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add lychee link checker github action (#2482)
```
  844f8819
16 Aug, 2025 2 commits
- docs: Add LMCache in vLLM README.md (#2462) · fb10ffb5
  ZichengMa authored Aug 15, 2025
```
Signed-off-by: ZichengMa <zichengma1225@gmail.com>
```
  fb10ffb5
- fix: revert registering runtime config for trtllm backend (deadlock) (#2464) · eaf42eb0
  Yan Ru Pei authored Aug 15, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  eaf42eb0
15 Aug, 2025 7 commits
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
- chore(sglang): Warn if --skip-tokenizer-init missing (#2463) · 57454300
  Graham King authored Aug 15, 2025
  
  57454300
- fix: fix examples (#2459) · a4e06895
  julienmancuso authored Aug 15, 2025
  
  a4e06895
- feat: Support `python -m dynamo.frontend --version` (#2449) · ccc8c627
  Graham King authored Aug 15, 2025
  
  ccc8c627
- fix: remove add_labels in Component (#2458) · 24a935e5
  Keiven C authored Aug 15, 2025
  
  24a935e5
- feat: extract deploymentType as interface (#2405) · 72128596
  julienmancuso authored Aug 15, 2025
  
  72128596
- chore: Rename tensorrtllm framework to trtllm (#2435) · a3d624a7
  Tanmay Verma authored Aug 14, 2025
  
  a3d624a7
14 Aug, 2025 5 commits
- fix: operator defaults (#2398) · 81c27803
  mohammedabdulwahhab authored Aug 14, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  81c27803
- feat: Add a "model" label to Component metrics (#2389) · 3a3f5bf2
  Tzu-Ling Kan authored Aug 14, 2025
  
  3a3f5bf2
- feat: add RuntimeConfig to ModelEntry (#2311) · d0a63635
  Jorge António authored Aug 14, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  d0a63635
- fix: add instruction to deploy model with inference gateway (#2257) · b74b887b
  Biswa Panda authored Aug 14, 2025
  
  b74b887b
- fix: Update gpt-oss.md w/ HF CLI pip install (#2431) · 20ad730c
  Anish authored Aug 13, 2025
```
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  20ad730c
13 Aug, 2025 5 commits
- fix(ci): Reduce the free gpu memory fraction (#2433) · f6fef485
  Tanmay Verma authored Aug 13, 2025
  
  f6fef485
- feat: Add vars to multi-node trtllm slurm scripts to support xP yD deployments (#2429) · cebe9219
  Ryan McCormick authored Aug 13, 2025
  
  cebe9219
- test: add kv routing test for sglang (#2424) · c0ed76da
  ishandhanani authored Aug 13, 2025
```
Signed-off-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  c0ed76da
- chore: update wideep dockerfile for sgl to newest rel (#2422) · ebc84d6c
  ishandhanani authored Aug 12, 2025
  
  ebc84d6c
- feat: support sglang in sla planner (#2421) · e22f84ab
  Hongkuan Zhou authored Aug 12, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  e22f84ab
12 Aug, 2025 2 commits
- feat: Add performance sweeps for DeepSeek R1 on GB200 (#2387) · 1327e3bb
  Tanmay Verma authored Aug 12, 2025
  
  1327e3bb
- feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68
  Hongkuan Zhou authored Aug 12, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  b4189c68
11 Aug, 2025 3 commits
- docs: add sglang installation variants (#2400) · d51580a4
  ishandhanani authored Aug 11, 2025
  
  d51580a4
- fix: use default batch_size for decode (#2376) · 43854732
  Neal Vaidya authored Aug 10, 2025
  
  43854732
- docs: add sglang hicache example and guide (#2388) · 3b722842
  Faradawn Yang authored Aug 10, 2025
  
  3b722842