Commits · bc290e7c710462b5885bdcef27ecc305a327ff8f · OpenDAS / dynamo · GitLab

20 Aug, 2025 19 commits
- feat: allow user to adjust kv_transfer_config (#2517) · bc290e7c
  Alec authored Aug 20, 2025
  
  bc290e7c
- feat(sglang): allow for multi worker spin up in slurm scripts (#2328) · e31c8790
  ishandhanani authored Aug 20, 2025
  
  e31c8790
- fix: Increase timeout for deepep test (#2572) · 11bc8a17
  Kris Hung authored Aug 20, 2025
  
  11bc8a17
- fix(hub): Download faster from Hugging Face (#2566) · d5b66fa2
  Graham King authored Aug 20, 2025
  
  d5b66fa2
- test: add dryrun mode for sla planner (#2557) · 1b3a1073
  Hongkuan Zhou authored Aug 20, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  1b3a1073
- feat(request cancellation): pycontext, propagating the `is_stopped` into python land. (#2158) · 626d7e18
  Michael Feil authored Aug 20, 2025
  
  626d7e18
- chore: Remove async-openai-macros (#2554) · 49958435
  Graham King authored Aug 20, 2025
  
  49958435
- fix: resources in wrong location in vllm disag_router example (#2558) · 539c18cd
  julienmancuso authored Aug 20, 2025
  
  539c18cd
- docs: Add pinned install for cuda-python in pip install path (#2553) · 40ea0fb5
  Ryan McCormick authored Aug 20, 2025
  
  40ea0fb5
- feat: upload/download rust structs directly through NATs object store (#2540) · d319abf3
  Yan Ru Pei authored Aug 20, 2025
  
  d319abf3
- docs: Add health check section to GPT OSS guide (#2556) · 8380f1bd
  Ryan McCormick authored Aug 20, 2025
  
  8380f1bd
- feat: add --tokenizer_path to profile_endpoint.py (#2550) · 59053354
  Jason Zhou authored Aug 20, 2025
  
  59053354
- feat: enhance devcontainer configuration and documentation (#2255) · 344c21dc
  Keiven C authored Aug 20, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  344c21dc
- test: lychee offline in pre-merge CI (full check only on push to main) (#2549) · f73d35d5
  Yan Ru Pei authored Aug 20, 2025
  
  f73d35d5
- feat: added parsers lib (#2542) · 526b02f1
  Ayush Agarwal authored Aug 20, 2025
  
  526b02f1
- test: Add deepep test for vllm (#2534) · 536280fc
  Kris Hung authored Aug 19, 2025
  
  536280fc
- chore: Bumped Dynamo version to 0.4.1 (#2545) · 9a021885
  Dmitry Tokarev authored Aug 19, 2025
  
  9a021885
- fix: Dockerfile.sglang - Fixed sglang and dynamo wheels installaiton in ru… (#2537) · 177d662f
  Dmitry Tokarev authored Aug 19, 2025
  
  177d662f
- chore: remove flatten for chat response types, add reasoning_content (#2543) · c12fe501
  nachiketb-nvidia authored Aug 19, 2025
```
Changing the chat completions response objects from structs to types of dynamo_async_openai

Implement aggregator traits for them chat completion structs

add reasoning_content under message and delta message in lib/async-openai
```
  c12fe501
19 Aug, 2025 21 commits
- docs: update grove ref to new url (#2538) · a0ddcbce
  Anant Sharma authored Aug 19, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  a0ddcbce
- fix: Fix KVBM Guide (#2539) · c0eaed48
  jthomson04 authored Aug 19, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  c0eaed48
- feat: Use health check and improve instructions for perf sweeps (#2423) · 86a4a58e
  Tanmay Verma authored Aug 19, 2025
  
  86a4a58e
- feat: Rename dynamo_component_concurrent_requests (#2515) · 6f7f6b12
  Tzu-Ling Kan authored Aug 19, 2025
```
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  6f7f6b12
- chore: Bring async-openai into repo as request starter (#2520) · 199b9a30
  nachiketb-nvidia authored Aug 19, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  199b9a30
- chore: add hhzhang16 to py codeowner (#2529) · 26d9f159
  Hongkuan Zhou authored Aug 19, 2025
  
  26d9f159
- docs: Add note for LMCache ARM support (#2535) · b9cbee0b
  ZichengMa authored Aug 19, 2025
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  b9cbee0b
- fix: Correct the metric name and labels. (#2508) · e5b6a054
  Tzu-Ling Kan authored Aug 19, 2025
  
  e5b6a054
- chore: Finish vllm upgrade to 0.10.1 + cleanup (#2528) · 5f57ea5f
  Dmitry Tokarev authored Aug 19, 2025
  
  5f57ea5f
- feat: kvbm + connector (#2258) · 07cfc3a1
  Ryan Olson authored Aug 19, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: John Thompson <jothomson@nvidia.com>
Co-authored-by: Richard Huo <rihuo@nvidia.com>
Co-authored-by: Zicheng Ma <zichengm@nvidia.com>
```
  07cfc3a1
- fix: add --enable-kvbm doc to build.sh help (#2530) · bf5862a1
  Harrison Saturley-Hall authored Aug 19, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  bf5862a1
- fix: Implement scaling Grove subresources (#2531) · a97602a2
  julienmancuso authored Aug 19, 2025
  
  a97602a2
- ci: run gitlab triggers on runner group (#2532) · af3d8aa0
  Anant Sharma authored Aug 19, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  af3d8aa0
- feat: task scheduler (#2406) · a33033b7
  Ryan Olson authored Aug 19, 2025
```
Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>
```
  a33033b7
- docs: Consolidate documentation and fix redundant headings (#2518) · 129a2444
  Anish authored Aug 19, 2025
  
  129a2444
- feat: add a knob to turn off correction factor in sla planner (#2511) · d9aef67e
  Hongkuan Zhou authored Aug 19, 2025
  
  d9aef67e
- docs: update support matrix with links to ngc (#2524) · cae5822a
  Harrison Saturley-Hall authored Aug 19, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  cae5822a
- feat: add mistral and phi4 tool parser (#2510) · 1ed877fa
  Ayush Agarwal authored Aug 19, 2025
  
  1ed877fa
- feat(frontend): support setting HTTP host via CLI (--http-host) (#2523) · c5d9d267
  suzu authored Aug 19, 2025
  
  c5d9d267
- feat: skip router when worker id is pre-determined (#2450) · 6bc6d400
  atchernych authored Aug 19, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  6bc6d400
- fix: Use `/usr` dir prefix when freeing disk space (#2514) · 57d4fa05
  Ryan McCormick authored Aug 19, 2025
  
  57d4fa05