Commits · d2e3b66e65df358d30749c4041de0648a2f19bfc · OpenDAS / dynamo

"vllm/vscode:/vscode.git/clone" did not exist on "77c4f45c6c949c4e56f838c43b6907f6473ea65f"

01 Oct, 2025 18 commits
- feat: Transition to FullyContiguous Host and Disk layouts (#3090) · d2e3b66e
  Olga Andreeva authored Oct 01, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>
```
  d2e3b66e
- fix: Polling from exhausted stream in preprocessor (#3349) · a5e1d45e
  Jacky authored Oct 01, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  a5e1d45e
- feat: Create worker selection pipeline (#3080) · 5194acbd
  atchernych authored Oct 01, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  5194acbd
- fix: etcd bucket delete missing prefix and metrics test range (#3331) · 0f63a05f
  Keiven C authored Oct 01, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0f63a05f
- feat: reasoning parser transformation (#3295) · 2a2bf58a
  Ayush Agarwal authored Oct 01, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2a2bf58a
- fix: DIS-706 skip offloading the G1 matched blocks during offloading (#3299) · 713e9e48
  Richard Huo authored Oct 01, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  713e9e48
- feat: restructure source code for python packaging (#3201) · 836d7417
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  836d7417
- feat: devcontainer.json to work for vLLM, SGLang, and TensorRT-LLM (#3228) · 4e38d628
  Keiven C authored Oct 01, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  4e38d628
- docs: fail build on warnings and fix existing warns (#3342) · c142eacf
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  c142eacf
- fix: null tools processing via minijinja (#3340) · 23e79552
  Ayush Agarwal authored Oct 01, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  23e79552
- feat: Add vLLM compilation cache to Dynamo Operator (#3257) · fcc42624
  Michael Shin authored Oct 01, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fcc42624
- feat: Using ai-perf for k8 FT tests. (#3289) · 02c822d6
  Tzu-Ling Kan authored Sep 30, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  02c822d6
- feat: Add --custom-jinja-template argument to pass a custom chat template for TRTLLM (#3332) · b5782fcd
  KrishnanPrash authored Sep 30, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b5782fcd
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
- chore: enable gpt oss reasoning to work with text and tokens (#3321) · 3d2d7e47
  Ayush Agarwal authored Sep 30, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  3d2d7e47
- refactor: standardize Prometheus metric naming conventions (part 1) (#3035) · f4a3a6b6
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f4a3a6b6
- fix: update post-create.sh for current build system and fix unbound variables (#3304) · cab23f21
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  cab23f21
- feat: add Context class to Python type stubs (#3327) · af4c0cad
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  af4c0cad
30 Sep, 2025 22 commits
- feat: Add --custom-jinja-template argument to pass a custom chat template for SGLang (#3165) · f95ba894
  KrishnanPrash authored Sep 30, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f95ba894
- fix: allow tolerations and affinity to be set in jobs that run during helm install (#3324) · 65401d75
  Julien Mancuso authored Sep 30, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  65401d75
- fix: Edge cases for Parallel tool calling (#3283) · 9088e1b5
  Elyas Mehtabuddin authored Sep 30, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
```
  9088e1b5
- fix: fix the lmcache args in the agg_lmcache.sh script (#3325) · 1a6eb099
  Richard Huo authored Sep 30, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  1a6eb099
- chore: update slurm scrips for better warmup and bump sgl version (#3291) · 0ab6bc2b
  ishandhanani authored Sep 30, 2025
  
  0ab6bc2b
- refactor: Simplify TRT-LLM request abort calling logic (#3296) · 87190db0
  Jacky authored Sep 30, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  87190db0
- feat: add audit logging for chat completions (#3062) · 56d20f53
  ryan-lempka authored Sep 30, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  56d20f53
- feat: python add abi compatability for cross-platform builds + add a unit test... · 5b457b70
  Michael Feil authored Sep 30, 2025
```
feat: python add abi compatability for cross-platform builds + add a unit test to HttpServer (#3044)
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: root <root@michaelfeil2-dev-pod-b200-0.michaelfeil2-dev-pod-b200.baseten.svc.cluster.local>
Signed-off-by: root <root@michaelfeildns-dev-pod-h100-0.michaelfeildns-dev-pod-h100.baseten.svc.cluster.local>
Co-authored-by: root <root@michaelfeil2-dev-pod-b200-0.michaelfeil2-dev-pod-b200.baseten.svc.cluster.local>
Co-authored-by: root <root@michaelfeildns-dev-pod-h100-0.michaelfeildns-dev-pod-h100.baseten.svc.cluster.local>
```
  5b457b70
- chore: Add Key abstraction in our KeyValueStore (#3322) · 50cdae5f
  Graham King authored Sep 30, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  50cdae5f
- fix: update ecs deployment example (#3284) · cf3ac5b6
  Neal Vaidya authored Sep 30, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  cf3ac5b6
- fix: Fix gpt_oss_parser last_content_delta to accumulate tokens + add regression test (#3301) · 95042f82
  zhongdaor-nv authored Sep 30, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  95042f82
- fix: python bindings for router should register to etcd as well (#3302) · d354763c
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d354763c
- fix: Install right versions of the dependencies for tensorrtllm (#3218) · c265cd67
  Tanmay Verma authored Sep 30, 2025
  
  c265cd67
- fix: KV Router bindings docs (#3308) · f0041782
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f0041782
- docs: remove base container as it varies, note no support trtllm py 3.11 (#3312) · 889e7f4b
  Harrison Saturley-Hall authored Sep 30, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  889e7f4b
- fix: fail fast custom template not found & more verbose vllm engine error (#3278) · 97fee502
  Chia-Wei authored Sep 30, 2025
```
Signed-off-by: Chia-Wei Chen <cchen562@wisc.edu>
```
  97fee502
- feat: add Python const for Prometheus metric names (#3244) · cacac9b9
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  cacac9b9
- refactor: standardize HF_CACHE to HF_HOME across codebase (use Hugging Face convention) (#3310) · 481bf395
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  481bf395
- chore: Move model_input, model_type from ModelEntry to ModelDeploymentCard (#3292) · 6ffd20a8
  Graham King authored Sep 30, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6ffd20a8
- fix: fix backend in trtllm multinode example (#3311) · 50dfd3af
  Julien Mancuso authored Sep 30, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  50dfd3af
- fix: make HF cache mount point dynamic based on target (#3270) · 8c884345
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8c884345
- test: create a helper function to send request directly to mocker instances (#3269) · 74a56676
  Paul Li authored Sep 29, 2025
```
Signed-off-by: Paul Li <zhixiong2008@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  74a56676