---
id: pr-sglang-10678
repo: sgl-project/sglang
pr: 10678
title: '[2/2] Support deterministic inference for temperature > 0'
author: Qiaolin-Yu
date: '2025-09-22'
url: https://github.com/sgl-project/sglang/pull/10678
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: e2ac7888b8cb1fd6c33a7ec58d27a5f5b5b24e0c
inclusion_reason: include
changed_paths:
- python/sglang/srt/layers/sampler.py
- python/sglang/srt/managers/schedule_batch.py
- python/sglang/srt/managers/tp_worker.py
- python/sglang/srt/model_executor/model_runner.py
- python/sglang/srt/sampling/sampling_batch_info.py
- python/sglang/srt/sampling/sampling_params.py
- python/sglang/srt/server_args.py
- python/sglang/test/test_deterministic.py
- sgl-router/benches/request_processing.rs
- sgl-router/src/protocols/spec.rs
- sgl-router/src/routers/http/openai_router.rs
- sgl-router/tests/test_openai_routing.rs
artifact_dir: evidence/pull-bundles/sglang/gh-10678
head_ref_oid: 49675451e8781dfa2cabcc6ac9a56e53b0946639
---
# [2/2] Support deterministic inference for temperature > 0

- Repository: `sgl-project/sglang`
- PR: [10678](https://github.com/sgl-project/sglang/pull/10678)
- Decision: `include`
- Reason: include

## Changed Paths

- `python/sglang/srt/layers/sampler.py`
- `python/sglang/srt/managers/schedule_batch.py`
- `python/sglang/srt/managers/tp_worker.py`
- `python/sglang/srt/model_executor/model_runner.py`
- `python/sglang/srt/sampling/sampling_batch_info.py`
- `python/sglang/srt/sampling/sampling_params.py`
- `python/sglang/srt/server_args.py`
- `python/sglang/test/test_deterministic.py`
- `sgl-router/benches/request_processing.rs`
- `sgl-router/src/protocols/spec.rs`
- `sgl-router/src/routers/http/openai_router.rs`
- `sgl-router/tests/test_openai_routing.rs`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-10678`
