Commits · be0058bc0584c44ea749e332be1432909a7228c9 · zhaoyu6 / sglang

"...lm-evaluation-harness.git" did not exist on "04ca56711786951549aaa29e7c5036ff029ca7f6"

19 Oct, 2025 1 commit
- [1/2][feature] support openai like classification api (#11618) · b5e14b2b
  ybyang authored Oct 19, 2025
  
  b5e14b2b
18 Oct, 2025 4 commits
- support server arg override KV cache to bf16 to avoid slow cases (#11749) · f9a7d9b3
  b8zhong authored Oct 18, 2025
  
  f9a7d9b3
- Fix install instructions and pyproject.tomls (#11781) · 67e34c56
  Lianmin Zheng authored Oct 18, 2025
  
  67e34c56
- fix command line usage of profiling (#11793) · 547003bd
  Qiaolin Yu authored Oct 17, 2025
  
  547003bd
- Set CUDA_VISIBLE_DEVICES to achieve one GPU per process (#9170) · 9eefe2c0
  Lianmin Zheng authored Oct 17, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Cheng Wan <cwan@x.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  9eefe2c0
17 Oct, 2025 2 commits
- [minor] sync code on python/sglang/test/test_deterministic.py and improve ci tests (#11777) · b9a54e09
  Lianmin Zheng authored Oct 17, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  b9a54e09
- [doc] update router document (#11767) · 2bc3fcd4
  Keyang Ru authored Oct 17, 2025
  
  2bc3fcd4
16 Oct, 2025 2 commits
- chore: bump SGLang version to 0.5.3.post3 (#11693) · 85ebeecf
  sglang-bot authored Oct 16, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  85ebeecf
- Sync code and test CI; rename some env vars (#11686) · cd7e1bd5
  Lianmin Zheng authored Oct 15, 2025
  
  cd7e1bd5
15 Oct, 2025 6 commits
- chore: bump SGLang version to 0.5.3.post2 (#11680) · baf277a9
  sglang-bot authored Oct 15, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  baf277a9
- [sgl-kernel] Optimize gguf test (#11667) · 54644572
  Fan Yin authored Oct 16, 2025
  
  54644572
- docs: update sglang installation guide (#11659) · ab9187a2
  Yineng Zhang authored Oct 15, 2025
  
  ab9187a2
- [Doc] Update support matrix for attn and hybrid attn (#11293) · 6bc503af
  b8zhong authored Oct 14, 2025
  
  6bc503af
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
- [router] update router doc to latest features (#11639) · e0c2af2a
  Simo Lin authored Oct 14, 2025
  
  e0c2af2a
14 Oct, 2025 5 commits
- Update install.md (#11631) · d314bf60
  Lianmin Zheng authored Oct 14, 2025
  
  d314bf60
- [Docs] [Router]: Update sg-router doc on circuit breaker (#11449) · 642fa966
  Wenyi Xu authored Oct 14, 2025
  
  642fa966
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
- bench_serving support PD Disaggregation (#11542) · 88a6f9da
  Xiaoyu Zhang authored Oct 14, 2025
  
  88a6f9da
- [FEATURE] Add Profile Trace Merger for Distributed Traces (#11413) · aaf7af1b
  Neelabh Sinha authored Oct 13, 2025
  
  aaf7af1b
13 Oct, 2025 3 commits
- Move deep gemm related arguments to `sglang.srt.environ` (#11547) · acc2327b
  Liangsheng Yin authored Oct 14, 2025
  
  acc2327b
- [HICache]: Support 3FS-Store with page_first_direct layout (#11460) · 318424e2
  hzh0425 authored Oct 13, 2025
  
  318424e2
- docs(router): add token-bucket rate limiting to the docs (#11485) · 8e776c78
  Jonah Bernard authored Oct 12, 2025
  
  8e776c78
12 Oct, 2025 2 commits
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
- [Feature] support regex strings as a stopping condition (#10635) · 47c606d3
  Glen Liu authored Oct 11, 2025
  
  47c606d3
11 Oct, 2025 1 commit
- [Documentation][Configuration] Server args and documentation of PD-Multiplexing. (#11427) · f5754d12
  ykcombat authored Oct 11, 2025
  
  f5754d12
10 Oct, 2025 1 commit
- Dedicated toml files for CPU/XPU (#10734) · f19613e6
  Zaili Wang authored Oct 10, 2025
  
  f19613e6
09 Oct, 2025 1 commit
- chore: bump SGLang version to 0.5.3.post1 (#11324) · 758b887a
  sglang-bot authored Oct 09, 2025
  
  758b887a
08 Oct, 2025 6 commits
- model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909) · d6837aea
  Netanel Haber authored Oct 08, 2025
```
Signed-off-by: Netanel Haber <nhaber@nvidia.com>
```
  d6837aea
- benchmark: enhance configurable multimodal benchmarking in bench_serving (#9812) · e3bb7f5a
  Kevin Xiang Li authored Oct 08, 2025
```
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  e3bb7f5a
- [Doc] Update mooncake nvlink transport doc for PD disaggregation (#11321) · 0a7c4bde
  Shangming Cai authored Oct 08, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  0a7c4bde
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
- [Feature] Add /tokenize and /detokenize OpenAI compatible endpoints (#9545) · 7c3f07db
  Adarsh Shirawalmath authored Oct 08, 2025
  
  7c3f07db
- update sampling_params documentation with defaults (#11315) · c4d77774
  Xinyuan Tong authored Oct 07, 2025
  
  c4d77774
07 Oct, 2025 4 commits
- Update tool parser and related documentation (#11223) · e3c7f091
  Xinyuan Tong authored Oct 07, 2025
  
  e3c7f091
- [Doc]: Best Practice for HICache (#11001) · df08bf9b
  hzh0425 authored Oct 08, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  df08bf9b
- [Doc] HiCache Design Documents (#11027) · 69efdd27
  ykwd authored Oct 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  69efdd27
- [Docs] [Router] Update Observability and Common Issues Section (#11302) · 0958a397
  Wenyi Xu authored Oct 07, 2025
  
  0958a397
06 Oct, 2025 2 commits
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
- chore: bump SGLang version to 0.5.3 (#11263) · a4a3d823
  sglang-bot authored Oct 06, 2025
  
  a4a3d823