Commits · 37adc0a83ffea40084441cbf8489b7d4e7da5a94 · OpenDAS / dynamo

"lib/llm/src/vscode:/vscode.git/clone" did not exist on "b950034bce4b0aa38b0a9c69139901205efb3407"

28 Aug, 2025 1 commit
- feat: Integrate Model Express Client into Dynamo Model Downloads (#2574) · 95ce83d5
  KavinKrishnan authored Aug 28, 2025
```
Signed-off-by: Kavin Krishnan <kavink@nvidia.com>
Co-authored-by: KavinKrishnan <kavin.krishnan@nvidia.com>
```
  95ce83d5
27 Aug, 2025 2 commits
- feat: KServe gRPC support (#2638) · 91a459c0
  GuanLuo authored Aug 26, 2025
  
  91a459c0
- feat: Trtllm metric_labels. (#2666) · ef535edb
  Tzu-Ling Kan authored Aug 26, 2025
  
  ef535edb
25 Aug, 2025 3 commits
- feat: python bindings for the entire KvPushRouter + per-request router configs (#2658) · f08729ae
  Yan Ru Pei authored Aug 25, 2025
  
  f08729ae
- feat: add gpt oss reasoning parser through harmony (#2656) · 3036e60b
  nachiketb-nvidia authored Aug 25, 2025
```
- couple of refactors
- added a new dependency, openai-harmony
- implemented the gpt oss parser
```
  3036e60b
- feat: add initial batch of KVBM metrics on match, offload and onboard (#2673) · b39382ba
  Ziqi Fan authored Aug 25, 2025
  
  b39382ba
24 Aug, 2025 1 commit
- fix: pytest robustness and parsing error (#2676) · 9b9f2ce4
  Alec authored Aug 24, 2025
  
  9b9f2ce4
22 Aug, 2025 4 commits
- feat: [vLLM] implement cli args for tool and reasoning parsers (#2619) · cbe854fc
  Ayush Agarwal authored Aug 22, 2025
  
  cbe854fc
- feat: enable dynamo metrics on KVBM (#2626) · b658ba61
  Ziqi Fan authored Aug 22, 2025
  
  b658ba61
- feat: add BaseLogitsProcessor core interface (#2613) · b92a805e
  Bhuvan Agrawal authored Aug 22, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
```
  b92a805e
- chore(llm): Rename protocols::Endpoint to EndpointId (#2615) · 6a358f7c
  Graham King authored Aug 22, 2025
  
  6a358f7c
21 Aug, 2025 2 commits
- fix: Httpengine sync-enable-endpoint (#2591) · 174389e6
  Michael Feil authored Aug 21, 2025
  
  174389e6
- feat: Add model label for vllm backend metrics (#2474) · 57728909
  Tzu-Ling Kan authored Aug 21, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  57728909
20 Aug, 2025 5 commits
- feat(request cancellation): pycontext, propagating the `is_stopped` into python land. (#2158) · 626d7e18
  Michael Feil authored Aug 20, 2025
  
  626d7e18
- chore: Remove async-openai-macros (#2554) · 49958435
  Graham King authored Aug 20, 2025
  
  49958435
- feat: upload/download rust structs directly through NATs object store (#2540) · d319abf3
  Yan Ru Pei authored Aug 20, 2025
  
  d319abf3
- chore: Bumped Dynamo version to 0.4.1 (#2545) · 9a021885
  Dmitry Tokarev authored Aug 19, 2025
  
  9a021885
- fix: Dockerfile.sglang - Fixed sglang and dynamo wheels installaiton in ru… (#2537) · 177d662f
  Dmitry Tokarev authored Aug 19, 2025
  
  177d662f
19 Aug, 2025 5 commits
- chore: Bring async-openai into repo as request starter (#2520) · 199b9a30
  nachiketb-nvidia authored Aug 19, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  199b9a30
- feat: kvbm + connector (#2258) · 07cfc3a1
  Ryan Olson authored Aug 19, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: John Thompson <jothomson@nvidia.com>
Co-authored-by: Richard Huo <rihuo@nvidia.com>
Co-authored-by: Zicheng Ma <zichengm@nvidia.com>
```
  07cfc3a1
- feat: task scheduler (#2406) · a33033b7
  Ryan Olson authored Aug 19, 2025
```
Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>
```
  a33033b7
- feat(frontend): support setting HTTP host via CLI (--http-host) (#2523) · c5d9d267
  suzu authored Aug 19, 2025
  
  c5d9d267
- feat: router-level request rejection (#2465) · 85d83108
  Yan Ru Pei authored Aug 19, 2025
  
  85d83108
18 Aug, 2025 2 commits
- feat(http): TLS support (#2492) · a4bbe492
  Graham King authored Aug 18, 2025
  
  a4bbe492
- fix: replace metrics callback with background scraping to prevent tim… (#2480) · 04442173
  Keiven C authored Aug 18, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  04442173
15 Aug, 2025 2 commits
- fix: remove kvmanager feature from python 3.12 ai-dynamo-runtime wheel (#2456) · ffae72b7
  Harrison Saturley-Hall authored Aug 15, 2025
  
  ffae72b7
- feat(metrics): add NATS client metrics to prometheus_metrics_fmt (#2292) · acbdabc4
  Keiven C authored Aug 14, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  acbdabc4
14 Aug, 2025 2 commits
- feat: Add a "model" label to Component metrics (#2389) · 3a3f5bf2
  Tzu-Ling Kan authored Aug 14, 2025
  
  3a3f5bf2
- feat: add RuntimeConfig to ModelEntry (#2311) · d0a63635
  Jorge António authored Aug 14, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  d0a63635
13 Aug, 2025 2 commits
- fix: upgrade cudarc to 0.17.1 (#2341) · c12c2578
  Dan Aloni authored Aug 13, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  c12c2578
- feat: Allow an endpoint to serve multiple models (#2418) · 72ec5f5c
  Graham King authored Aug 13, 2025
  
  72ec5f5c
12 Aug, 2025 1 commit
- feat: multi-modal example with vLLM v1 and UX v2 (#2040) · 9b87c89c
  GuanLuo authored Aug 12, 2025
```
Co-authored-by: krishung5 <krish@nvidia.com>
```
  9b87c89c
07 Aug, 2025 3 commits
- feat: Router replicas with state-sharing (#2264) · 5166a3dd
  Yan Ru Pei authored Aug 07, 2025
  
  5166a3dd
- feat: cross process instrumentation (#2243) · bd4fe1a7
  Neelay Shah authored Aug 07, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
```
  bd4fe1a7
- chore: Remove service_name from ModelDeploymentCard (#2349) · 1954fcfa
  Graham King authored Aug 07, 2025
  
  1954fcfa
06 Aug, 2025 3 commits
- chore: Bump mistral.rs, llama.cpp and tokenizers deps (#2338) · dbe48a1d
  Graham King authored Aug 06, 2025
  
  dbe48a1d
- fix: upgrade axum to 0.8 and etcd-client to 0.16 (#2317) · b2aa504b
  Dan Aloni authored Aug 06, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
```
  b2aa504b
- feat: Support static workers, run without etcd. (#2281) · 6a1a801c
  Graham King authored Aug 06, 2025
  
  6a1a801c
05 Aug, 2025 2 commits
- feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e
  Hongkuan Zhou authored Aug 05, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  36c4ef5e
- feat: Allow Python Engine to end stream before final (#2270) · 347620a1
  Jacky authored Aug 05, 2025
  
  347620a1