Commits · 14321c8fe778478cd2a0abb9c2c9c0847ef53f64 · OpenDAS / dynamo

"examples/backends/vllm/vscode:/vscode.git/clone" did not exist on "d2a5783938a5b7e8711d5c60c4d5918cc4a15f12"

09 Dec, 2025 8 commits
- fix: backend error serialization and add HTTP status code detection (#4786) · 065f466e
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  065f466e
- chore(pipeline): Move migration outside of backend (#4823) · d5f425ab
  Graham King authored Dec 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  d5f425ab
- feat: Disable health checks by default; auto-enable in K8s via operator (#4804) · 7c15166d
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  7c15166d
- feat: add tool_choice support (#4722) · 5585f803
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  5585f803
- feat: Change health check log level from info to debug (#4818) · 1f9b69b0
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1f9b69b0
- fix: add timeout to tests before lora to unblock (#4808) · 1e37c103
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1e37c103
- fix: have frontend populate "stop" field in OpenAI request (#4782) · e6de33f8
  Page authored Dec 08, 2025
  
  e6de33f8
- fix: Fix warning messages with healthcheck (#4793) · bd4366d0
  jthomson04 authored Dec 08, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  bd4366d0
08 Dec, 2025 2 commits
- chore: de-spaghetti mocker scheduler (#4789) · 377711d3
  Yan Ru Pei authored Dec 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  377711d3
- chore: jamba based parsers (#4776) · c9fad85c
  Ayush Agarwal authored Dec 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c9fad85c
06 Dec, 2025 1 commit
- test: add timeout for lora utils tests (#4781) · 5588d770
  Biswa Panda authored Dec 05, 2025
  
  5588d770
05 Dec, 2025 3 commits
- fix: use channel to avoid race condition from async nats registration task (#4758) · 501ef021
  Biswa Panda authored Dec 05, 2025
  
  501ef021
- feat: Add python-configurable engine routes for sglang profiling (#4617) · 3bc129dc
  William Arnold authored Dec 05, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  3bc129dc
- build: Enable frontend decoding (media-nixl) in regular dynamo builds (#4618) · 76f4bc83
  KrishnanPrash authored Dec 05, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  76f4bc83
04 Dec, 2025 6 commits
- fix: skip HuggingFace download for non-llms (#4686) · 118323f2
  Neal Vaidya authored Dec 04, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  118323f2
- refactor: remove legacy NATS metrics and stats_handler (#4680) · 00b64ae0
  Keiven C authored Dec 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  00b64ae0
- fix: vLLM xfer bug (#4745) · 173201f5
  Alec authored Dec 04, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  173201f5
- fix: parallel tool call indices in streaming (#4723) · 8601ccdb
  Vladislav Nosivskoy authored Dec 04, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  8601ccdb
- feat: Turn on canary health check by default (#4368) · d5800311
  Tzu-Ling Kan authored Dec 03, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d5800311
- chore: no need to arc wrap client (#4741) · 5b24b429
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5b24b429
03 Dec, 2025 6 commits
- chore: bump vLLM to 0.11.2 (#4476) · 60feb955
  Karen Chung authored Dec 03, 2025
  
  60feb955
- chore: Arc wrap prometheus_registry in MetricsRegistry (#4677) · c5e8c4c2
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c5e8c4c2
- fix: Updates CUDA fatbin for KVBM (#4700) · 991d8c72
  Olga Andreeva authored Dec 03, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  991d8c72
- feat: add Kserve readiness endpoint support: ServerLive / ServerReady / ModelReady (#4708) · d90dc39d
  GuanLuo authored Dec 03, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  d90dc39d
- test: remove redundant mocker e2e test in rust (#4720) · 77841e7b
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  77841e7b
- fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port... · 3cad926e
  Keiven C authored Dec 02, 2025
```
fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port binding, and update etcd test (#4687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3cad926e
02 Dec, 2025 6 commits

feat: Extend the KV Event Consolidator to support TensorRT-LLM (#4533) · 6067c59d
Kris Hung authored Dec 02, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
6067c59d

fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union... · 4ace4c85

GuanLuo authored Dec 02, 2025

fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union from different files (#3192)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

4ace4c85

refactor: New config types for tool calls (#4575) · 44e8600a

William Zhang authored Dec 02, 2025

* Why?

We would like the ability to configure different parser types. Prior to
this commit, only the JSON parser could be configured.

* What?

This commit refactors the tool parser config in the following ways:
- the `format` and `json` fields of `ToolParserConfig` are merged into
  a single `config` field that is a "discriminated union" type. Each
  parser type can declare its own configuration options.
- a `XmlParserConfig` is defined with a default factory method that
  corresponds to the Qwen3 coder configuration.
- affected calls and tests are adjusted.

44e8600a

fix(FileStore): Stop keep-alive thread on cancellation token. (#4666) · c9fdc2ea
Graham King authored Dec 02, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
c9fdc2ea
feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
Biswa Panda authored Dec 02, 2025

71f94eda
feat: dynamic setting of thresholds for rejection (#4673) · 4c1bc4ee
Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
4c1bc4ee

01 Dec, 2025 1 commit
- fix: Page-align O_DIRECT writes for Lustre compatibility (#4508) · 5d9fc858
  Olga Andreeva authored Dec 01, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  5d9fc858
26 Nov, 2025 2 commits
- fix: allow router to be registered as general transport type (#4633) · ea9d00e7
  Yan Ru Pei authored Nov 26, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ea9d00e7
- feat: add LoRA common APIs and implementation for lora management (#4464) · 6a0e67ed
  Biswa Panda authored Nov 26, 2025
  
  6a0e67ed
25 Nov, 2025 5 commits

refactor(storage): Remove the stuttering from key_value_store. (#4604) · fcb91e4b
Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
fcb91e4b
chore: make router use the discovery pattern instead of manual kv watch (#4597) · 9c5018e5
Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
9c5018e5
chore(runtime): Make nats_client private, refactor NATS stats scraping (#4591) · 17dcffe8
Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
17dcffe8

feat: decoded media via NIXL (#3988) · 0a065918

milesial authored Nov 25, 2025


Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

0a065918

refactor(llm): Rename EngineConfig::Static to InProcess (#4585) · 0fc5273c
Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
0fc5273c