Commits · 7f028b07c4cdd28b6b874cab2f0dd747e87f385f · change / sglang

16 Sep, 2025 2 commits
- Fix formatting in long code blocks (#10528) · 7f028b07
  Philip Kiely - Baseten authored Sep 16, 2025
  
  7f028b07
- [CPU] fix CPU backend sel. issue for Llama4 (#10511) · 925dbb32
  Zaili Wang authored Sep 16, 2025
  
  925dbb32
15 Sep, 2025 5 commits
- [2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for... · 3f41b48c
  Lifu Huang authored Sep 15, 2025
```
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
```
  3f41b48c
- model: support solar (#8189) · a45d9a4e
  Praneth Paruchuri authored Sep 15, 2025
  
  a45d9a4e
- chore: bump v0.5.3rc0 (#10468) · 86a32bb5
  Yineng Zhang authored Sep 15, 2025
  
  86a32bb5
- Run tests based on labels (#10456) · 50dc0c1e
  Lianmin Zheng authored Sep 15, 2025
  
  50dc0c1e
- Add reasoning examples for GPT-OSS in Markdown examples (#9626) · 0b14159f
  Vincent Zhong authored Sep 14, 2025
  
  0b14159f
14 Sep, 2025 1 commit

[Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 1 (#9962) · 4c21b090

Feng Su authored Sep 15, 2025


Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
Signed-off-by: Huaixin Chang <changhuaixin@linux.alibaba.com>
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>

4c21b090

12 Sep, 2025 2 commits
- [NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#9199) · 3df05f4d
  Shu Wang authored Sep 11, 2025
  
  3df05f4d
- [CPU][doc] add torch.compile param in example commands (#10349) · 7bc5fb0d
  Zaili Wang authored Sep 12, 2025
  
  7bc5fb0d
11 Sep, 2025 3 commits
- chore: bump v0.5.2 (#10221) · b0d25e72
  Yineng Zhang authored Sep 11, 2025
  
  b0d25e72
- add qwen3-next doc (#10327) · 760b788a
  Yi Zhang authored Sep 12, 2025
  
  760b788a
- [CPU] fix OOM when mem-fraction is not set (#9090) · ef959d7b
  Zaili Wang authored Sep 11, 2025
  
  ef959d7b
10 Sep, 2025 1 commit
- [doc] add walkthrough for implementing and hosting a simple llama wrapper m… (#10093) · ebd0e1c1
  Glen Liu authored Sep 10, 2025
  
  ebd0e1c1
09 Sep, 2025 3 commits
- Updated Nvidia Jetson docs (#4422) · 2fe17735
  Shakhizat Nurgaliyev authored Sep 09, 2025
  
  2fe17735
- Update link for EAGLE speculative decoding (#10191) · ba066ca0
  geray authored Sep 09, 2025
  
  ba066ca0
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7
08 Sep, 2025 4 commits
- [Bench] feat: mooncake trace integration (#9839) · a02071a1
  Teng Ma authored Sep 09, 2025
```
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
```
  a02071a1
- Revert "enable auto-round quantization model (#6226)" (#10148) · b7d1f17b
  Yineng Zhang authored Sep 07, 2025
  
  b7d1f17b
- enable auto-round quantization model (#6226) · c8295d23
  Weiwei authored Sep 08, 2025
```
Signed-off-by: Zhang, Weiwei1 <weiwei1.zhang@intel.com>
```
  c8295d23
- Add graph runner support with torch compile on CPU (#7843) · 7577f0e4
  Cao E authored Sep 08, 2025
  
  7577f0e4
07 Sep, 2025 1 commit
- [DOC]: some minor updates (#10134) · b0fcbb74
  eigen authored Sep 07, 2025
  
  b0fcbb74
05 Sep, 2025 2 commits
- Simplify `Router` arguments passing and build it in docker image (#9964) · 6e95f5e5
  Liangsheng Yin authored Sep 05, 2025
  
  6e95f5e5
- chore: bump v0.5.2rc2 (#10050) · fa9c82d3
  Yineng Zhang authored Sep 04, 2025
  
  fa9c82d3
04 Sep, 2025 2 commits
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
- [Doc] Fix SGLang tool parser doc (#9886) · 75ee0011
  Huapeng Zhou authored Sep 04, 2025
  
  75ee0011
03 Sep, 2025 1 commit
- Move parsers under a single folder (#9912) · 60e37f80
  Lianmin Zheng authored Sep 02, 2025
  
  60e37f80
02 Sep, 2025 2 commits
- chore: bump v0.5.2rc1 (#9920) · 18f91eb6
  Yineng Zhang authored Sep 02, 2025
  
  18f91eb6
- [chore] fix dead links in doc (#9913) · 1fbfdebe
  Lifu Huang authored Sep 02, 2025
  
  1fbfdebe
01 Sep, 2025 1 commit
- chore: bump v0.5.2rc0 (#9862) · 16e56ea6
  Yineng Zhang authored Sep 01, 2025
  
  16e56ea6
29 Aug, 2025 1 commit
- [HiCache] change the default policy to write through (#9772) · 001f5194
  Zhiqiang Xie authored Aug 28, 2025
  
  001f5194
27 Aug, 2025 2 commits

chore: bump v0.5.1.post3 (#9716) · bc80dc4c
Yineng Zhang authored Aug 27, 2025

bc80dc4c

[docs] Instructions for bench_serving.py (#9071) · a85363c1

yhyang201 authored Aug 27, 2025


Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

a85363c1

26 Aug, 2025 2 commits
- [doc] add kimik2 --tool-call-parser (#9647) · 1a0896e9
  Xiaotong Jiang authored Aug 26, 2025
  
  1a0896e9
- model: Support nvidia/Llama-3_1-Nemotron-Ultra-253B-v1 (#9301) · 4cd08dc5
  Netanel Haber authored Aug 26, 2025
  
  4cd08dc5
25 Aug, 2025 3 commits
- [docs] Refactor, remove compiled results and add gpt-oss (#9613) · 9b08d975
  Chayenne authored Aug 25, 2025
```
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
```
  9b08d975
- chore: bump v0.5.1.post2 (#9592) · e3e97a12
  Yineng Zhang authored Aug 25, 2025
  
  e3e97a12
- fix: Update OpenAI client base URL in documentation (#9576) · ca4b86c5
  Xinyuan Tong authored Aug 25, 2025
  
  ca4b86c5
24 Aug, 2025 1 commit
- chore: bump v0.5.1.post1 (#9558) · e0ab167d
  Yineng Zhang authored Aug 24, 2025
  
  e0ab167d
23 Aug, 2025 1 commit
- [doc] deepseekv31 support (#9544) · 80425e59
  Xiaotong Jiang authored Aug 23, 2025
  
  80425e59