Commits · 065f466e70060c3c5ef5f7a0d1acede1f3a810b8 · OpenDAS / dynamo · GitLab

09 Dec, 2025 17 commits
- fix: backend error serialization and add HTTP status code detection (#4786) · 065f466e
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  065f466e
- feat: unified tracing across dynamo + sglang (#4248) · fc161924
  ishandhanani authored Dec 09, 2025
  
  fc161924
- feat: KV aware LoRA request routing for vllm (#4810) · 8559c2bd
  Biswa Panda authored Dec 09, 2025
  
  8559c2bd
- fix: Add model registration to SGLang multimodal workers fixing bug #4486 (#4512) · ad5afb7b
  nancya-nv authored Dec 09, 2025
```
Signed-off-by: Nancy Agarwal <nancya@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  ad5afb7b
- chore(pipeline): Move migration outside of backend (#4823) · d5f425ab
  Graham King authored Dec 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  d5f425ab
- feat: Disable health checks by default; auto-enable in K8s via operator (#4804) · 7c15166d
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  7c15166d
- feat: fault tolerance rolling upgrade test scenarios (#4558) · a473402f
  Thomas Montfort authored Dec 09, 2025
  
  a473402f
- feat: add tool_choice support (#4722) · 5585f803
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  5585f803
- docs: Add multimodal documentation vllm, sglang, and trtllm backends (#4510) · 94d145a9
  Indrajit Bhosale authored Dec 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: krishung5 <krish@nvidia.com>
```
  94d145a9
- feat: add scaling adapter (#4699) · 09f2314d
  Julien Mancuso authored Dec 09, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  09f2314d
- feat: Change health check log level from info to debug (#4818) · 1f9b69b0
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1f9b69b0
- fix: add timeout to tests before lora to unblock (#4808) · 1e37c103
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1e37c103
- test: Pre-download models before tests are ran (#4811) · 4ca1679c
  Jacky authored Dec 08, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  4ca1679c
- fix: have frontend populate "stop" field in OpenAI request (#4782) · e6de33f8
  Page authored Dec 08, 2025
  
  e6de33f8
- fix: Fix warning messages with healthcheck (#4793) · bd4366d0
  jthomson04 authored Dec 08, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  bd4366d0
- fix: guided decoding params handling in vLLM (#4770) · 3e4b480b
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
```
  3e4b480b
- feat: migrate planner metrics to backend (1/3 vLLM) (#4134) · 197e0227
  daiyaanarfeen authored Dec 08, 2025
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
```
  197e0227
08 Dec, 2025 13 commits
- refactor: update Dockerfiles to use group writes for development, saving build time (#4657) · 0dd51694
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0dd51694
- feat: slurm jobs added fp4 and 8k1k (#4747) · 80dfb82c
  ishandhanani authored Dec 08, 2025
  
  80dfb82c
- test: router + sglang in pre-merge CI (#4767) · 3fea2e10
  Yan Ru Pei authored Dec 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3fea2e10
- chore: de-spaghetti mocker scheduler (#4789) · 377711d3
  Yan Ru Pei authored Dec 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  377711d3
- feat: add runtime sanity checks for runtime images (#4788) · 8f0ac731
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8f0ac731
- feat: update examples to use public lora (#4807) · 3bad9666
  Biswa Panda authored Dec 08, 2025
  
  3bad9666
- fix: remove workflow metric job (#4806) · d13c017d
  Nate Mailhot authored Dec 08, 2025
  
  d13c017d
- chore: jamba based parsers (#4776) · c9fad85c
  Ayush Agarwal authored Dec 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c9fad85c
- feat(fault-injection): Enable runtime CUDA fault injection toggling without pod restarts (#4679) · d2c23e41
  nv-oviya authored Dec 08, 2025
  
  d2c23e41
- fix: increase timeout for test_{sglang,vllm,trtllm} model download time (#4792) · 300e5d55
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  300e5d55
- fix: move new launch script to examples (#4800) · 8b197406
  Anant Sharma authored Dec 08, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8b197406
- fix: change pytest result artifact upload name to include job id and workf… (#4744) · 204d10d5
  Nate Mailhot authored Dec 08, 2025
  
  204d10d5
- ci: fix login for operator job and other sgl/trtllm tests (#4785) · 1645884d
  Dillon Cullinan authored Dec 08, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  1645884d
06 Dec, 2025 4 commits
- fix: restoring KVBM wheel generation for `framework=none` and adding CI validation (#4772) · 046229f2
  Olga Andreeva authored Dec 05, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  046229f2
- test: add timeout for lora utils tests (#4781) · 5588d770
  Biswa Panda authored Dec 05, 2025
  
  5588d770
- fix: Extra requests received by workers during FT tests (#4780) · d66e6755
  Jacky authored Dec 05, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  d66e6755
- test: add timeout markers to pytest.mark.gpu_1 serve tests (#4768) · 2472aa4a
  Keiven C authored Dec 05, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  2472aa4a
05 Dec, 2025 6 commits
- ci: Adding nightly pipeline workflow (#4204) · a9078ed0
  Pavithra Vijayakrishnan authored Dec 05, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
```
  a9078ed0
- ci: automatically update version picker when new version published (#4765) · d03c0976
  Neal Vaidya authored Dec 05, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  d03c0976
- docs: Guide for Speculative Decoding in VLLM using Eagle3 and Meta-Llama-3.1-8B-Instruct (#3895) · f315374f
  Dilreet Raju authored Dec 05, 2025
```
Signed-off-by: DilreetRaju <dilreetraju@gmail.com>
```
  f315374f
- fix(sglang): fix IPv6 support for ZMQ endpoint (#4403) · 3dbab3f1
  dmitrygx authored Dec 05, 2025
```
Signed-off-by: Dmitrii Gabor <dmitryg1709@gmail.com>
```
  3dbab3f1
- fix: add missed dependency for sglang tracing (#4621) · 21f6d1e6
  Vladislav Nosivskoy authored Dec 05, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  21f6d1e6
- test: Include a timeout marker to all Cancellation / Migration E2E tests (#4764) · 0fa9b998
  Jacky authored Dec 05, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  0fa9b998