Commits · 36c4ef5eb2736a4ac546f4e927e702d84da34dbd · OpenDAS / dynamo

"lib/llm/src/vscode:/vscode.git/clone" did not exist on "065f466e70060c3c5ef5f7a0d1acede1f3a810b8"

05 Aug, 2025 12 commits
- feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e
  Hongkuan Zhou authored Aug 05, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  36c4ef5e
- docs: add TRTLLM variable sliding window attention example for gemma3 model (#2134) · c8f6d4d9
  Richard Huo authored Aug 05, 2025
  
  c8f6d4d9
- feat: Allow Python Engine to end stream before final (#2270) · 347620a1
  Jacky authored Aug 05, 2025
  
  347620a1
- feat(health): extend /health endpoint to include instances (#1312) (#2011) · b48d4c3b
  heisenberglit authored Aug 05, 2025
  
  b48d4c3b
- fix: fix nil pointer deref in dynamo controller (#2293) · 9dba3c3f
  mohammedabdulwahhab authored Aug 05, 2025
  
  9dba3c3f
- docs: add GPT-OSS deployment guide (#2297) · 8964d0d5
  Neal Vaidya authored Aug 05, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: John Thomson (DLAlgo) <jothomson@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  8964d0d5
- feat: Parameterize health and live HTTP endpoint paths (#2230) · 7c8f8fdc
  Yingge He authored Aug 05, 2025
  
  7c8f8fdc
- feat: Pass user_data to register_llm for LoRA support (#2286) · 433f6012
  Chi authored Aug 05, 2025
  
  433f6012
- fix: show raw sglang logs given env var (#2287) · 4cbd4f38
  ishandhanani authored Aug 04, 2025
  
  4cbd4f38
- fix: Adjust frontEnd thrasholds (#2288) · 78ffe3d3
  atchernych authored Aug 04, 2025
  
  78ffe3d3
- fix: Update the NIXL TRTLLM commit version to rc4 (#2284) · 30f33524
  Tanmay Verma authored Aug 04, 2025
  
  30f33524
- fix: Update disagg configs for trtllm 1.0.0rc4 changes (main) (#2278) (#2282) · d537378a
  Ryan McCormick authored Aug 04, 2025
  
  d537378a
04 Aug, 2025 6 commits
- fix: Add common and test dependencies to sglang runtime build (#2279) · 4b8a748f
  Tushar Sharma authored Aug 04, 2025
  
  4b8a748f
- ci: fix sglang paths for nightly (#2275) · 8f005a61
  ishandhanani authored Aug 04, 2025
  
  8f005a61
- chore: sglang k8s health/live, update doc (#2272) · 26dc6281
  Hongkuan Zhou authored Aug 04, 2025
  
  26dc6281
- chore: update readme (#2262) · 6fed066b
  Iman Tabrizian authored Aug 04, 2025
```
Signed-off-by: Iman Tabrizian <10105175+Tabrizian@users.noreply.github.com>
```
  6fed066b
- fix: readme instructions for worker running (#2266) · 053ac33e
  ishandhanani authored Aug 04, 2025
  
  053ac33e
- docs: Remove `TRTLLM_USE_NIXL_KVCACHE` and `TRTLLM_USE_UCX_KVCACHE` environment variables (#2231) · dbb4caaf
  KrishnanPrash authored Aug 03, 2025
  
  dbb4caaf
03 Aug, 2025 1 commit
- docs(sglang): remove note about placeholder metrics implementation (#2256) · e5fa8b62
  ishandhanani authored Aug 02, 2025
  
  e5fa8b62
02 Aug, 2025 3 commits
- fix: fixed broken links (#2254) · c86052c9
  Anish authored Aug 01, 2025
  
  c86052c9
- fix: Update README.md for examples (#2236) · 92b22b9d
  Anish authored Aug 01, 2025
```
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  92b22b9d
- docs: Dyn 591 (#2247) · fa492bb1
  atchernych authored Aug 01, 2025
```
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  fa492bb1
01 Aug, 2025 8 commits
- feat: sglang + gb200 (#2223) · 959f810f
  ishandhanani authored Aug 01, 2025
  
  959f810f
- test: Request Migration Docs and E2E vLLM Tests (#2177) · ae51b3f4
  Jacky authored Aug 01, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  ae51b3f4
- docs: add a docs/guides/metrics.md (#2160) · faafa5ff
  Keiven C authored Aug 01, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  faafa5ff
- fix: dynamo_component to be added in metric names (#2180) · efd863d6
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  efd863d6
- feat: add sgl deploy readme (#2238) · 1ad6abed
  ishandhanani authored Jul 31, 2025
  
  1ad6abed
- fix: frontend metrics to be renamed from nv_llm_http_service_* => dynamo_frontend_* (#2176) · 8c75ed79
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8c75ed79
- feat: reduce / revert routing overheads, do not consider output tokens (#2182) · 66231cf0
  Yan Ru Pei authored Jul 31, 2025
  
  66231cf0
- fix: handle groveTerminationDelay and auto-detect grove installation (#2190) · dbd33df6
  julienmancuso authored Jul 31, 2025
  
  dbd33df6
31 Jul, 2025 10 commits
- chore: Remove multimodal readme. (#2212) · f14f59c2
  Kris Hung authored Jul 31, 2025
  
  f14f59c2
- fix: Integration tests fixes (#2161) · f10e44ca
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f10e44ca
- fix: Add default configs in LLMAPI. Fixes OOM issues (#2198) · 7e3b3fab
  Tanmay Verma authored Jul 31, 2025
  
  7e3b3fab
- chore: update nixl version to 0.4.1 (#2221) · 625578c3
  Anant Sharma authored Jul 31, 2025
  
  625578c3
- fix: fix endpoint run to return error DIS-325 (#2156) · cbc0e200
  Keiven C authored Jul 31, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  cbc0e200
- feat: skip downloading model weights if using mocker (only tokenizer) (#2213) · bae25dc6
  Yan Ru Pei authored Jul 31, 2025
  
  bae25dc6
- feat: reorganize sglang and add expert distribution endpoints (#2181) · 3bf22bb4
  ishandhanani authored Jul 31, 2025
  
  3bf22bb4
- fix: Migrating trtllm examples from `1.0.0rc0` to `1.0.4rc4` (#2217) · f10aab3b
  KrishnanPrash authored Jul 31, 2025
  
  f10aab3b
- fix(k8s): sglang disagg now uses decode worker (#2206) · 97390ac0
  ishandhanani authored Jul 30, 2025
  
  97390ac0
- fix: update SGLang version in instructions and Dockerfile to revert to 0.4.8.post1 (#2204) · c546b630
  ishandhanani authored Jul 30, 2025
  
  c546b630