Commits · 6535fda1279d300bce88e6d18190ef0d8d51f0cd · change / sglang

"vscode:/vscode.git/clone" did not exist on "4d641f7f56d4da78303c5a55846baa97d6505c86"

30 Sep, 2025 1 commit
- [Profile] dump memory trace when cuda graph profile is enabled (#11083) · 6535fda1
  Cheng Wan authored Sep 29, 2025
  
  6535fda1
29 Sep, 2025 21 commits
- feat(reasoning): improve enable thinking from request (#10875) · 3713eb61
  Jimmy authored Sep 30, 2025
  
  3713eb61
- [router][grpc] Add logprobs support to router (#11082) · 5937a56d
  Chang Su authored Sep 29, 2025
  
  5937a56d
- [router] Use `get_pooled` in `process_single_choice` (#11079) · f065e5be
  Chang Su authored Sep 29, 2025
  
  f065e5be
- fix: fp8 mllama4 without vision modules being quantized (#10611) · 9de1320b
  Mick authored Sep 30, 2025
  
  9de1320b
- Fix mem fraction static for nightly tests (#11076) · dda34c2f
  Lianmin Zheng authored Sep 29, 2025
  
  dda34c2f
- [router][tool call] Separate `JsonParser` and `LlamaParser` (#11073) · 4eeaff74
  Chang Su authored Sep 29, 2025
  
  4eeaff74
- Use more general heuristics to set the default value of --mem-fraction-static (#10975) · a17e70f5
  Lianmin Zheng authored Sep 29, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  a17e70f5
- [router] add n to generate sampling params (#11069) · 816b3a43
  Simo Lin authored Sep 29, 2025
  
  816b3a43
- chore: upgrade sgl-kernel 0.3.13 (#11056) · 3a641d90
  Yineng Zhang authored Sep 29, 2025
  
  3a641d90
- [Ci Monitor] Auto uploaded performance data to sglang_ci_data repo (#10976) · 6f16bf9d
  Xiaoyu Zhang authored Sep 29, 2025
  
  6f16bf9d
- chore: upgrade cutedsl 4.2.1 (#11054) · 5942fdb4
  Yineng Zhang authored Sep 29, 2025
  
  5942fdb4
- [router][tool call] Improve normal content extraction and error handling (non-stream) (#11050) · af4ab656
  Chang Su authored Sep 29, 2025
  
  af4ab656
- Fix sgl-kernel benchmark dead code (#11022) · 11965b0d
  Xiaoyu Zhang authored Sep 29, 2025
  
  11965b0d
- Fix gemma 3 launch with `transformers:` the error: `AttributeError:... · 71959545
  Vincent Zhong authored Sep 29, 2025
```
Fix gemma 3 launch with `transformers:` the error: `AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size'` (#9614)
```
  71959545
- [speculative decoding] rename lookahead to ngram (#11010) · 24f7cb1e
  Zhihao Zhang authored Sep 29, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
```
  24f7cb1e
- [HiCacheStorage] mooncake store support page_first_direct layout (#10591) · e05555fa
  huangtingwei authored Sep 29, 2025
  
  e05555fa
- fix: check if weights are already local before downloading (#11015) · 43fa9f22
  Mick authored Sep 29, 2025
  
  43fa9f22
- [1/2] Support FA4 for MHA Prefill in sgl-kernel (#10940) · e98d9346
  Lifu Huang authored Sep 28, 2025
  
  e98d9346
- Unify SGL Kernel Releases (#10701) · 0c917410
  Kangyan-Zhou authored Sep 28, 2025
  
  0c917410
- [router] add harmony tool parser base structure and interface (#11036) · 25728863
  Simo Lin authored Sep 28, 2025
  
  25728863
- [router][tool call] Support normal content extraction before tool call (streaming) (#11038) · dba751a8
  Chang Su authored Sep 28, 2025
  
  dba751a8
28 Sep, 2025 11 commits
- fix: show failed models in nightly ci (#10986) · 2e763398
  Mick authored Sep 29, 2025
  
  2e763398
- [router] migrate to rust python module for pythonic parser (#11033) · 336e9a60
  Simo Lin authored Sep 28, 2025
  
  336e9a60
- Update GLM-4.5 Model Doc (#11017) · abb67815
  Yuxuan Zhang authored Sep 29, 2025
  
  abb67815
- Fix FusedSetKVBufferArg in RotaryEmbedding (#11003) · 07440f5f
  Lianmin Zheng authored Sep 28, 2025
  
  07440f5f
- [HiCache] bug: fix mooncake store batch set v1 (#11013) · 9816989b
  Teng Ma authored Sep 28, 2025
  
  9816989b
- [sgl-kernel] Optimize concat_mla_k kernel (#10543) · 42245551
  Yuan Luo authored Sep 28, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: PGFLMG <1106310035@qq.com>
```
  42245551
- prepare for sglang+verl (#10555) · 2a9d995c
  lbk-sys authored Sep 28, 2025
```
Signed-off-by: lbk-sys <hello_lbk@163.com>
Signed-off-by: libaokui <libaokui@hauwei.com>
Co-authored-by: libaokui <libaokui@hauwei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
```
  2a9d995c
- [bugfix]Add empty_context import to two_batch_overlap.py (#10964) · a9050b5c
  wejoncy authored Sep 28, 2025
  
  a9050b5c
- Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected... · 66face35
  YanbingJiang authored Sep 28, 2025
```
Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected keyword argument 'fused_set_kv_buffer_arg' (#11009)
```
  66face35
- [router] fix chat template loading and tokenizer path (#10999) · 5519766a
  Simo Lin authored Sep 27, 2025
  
  5519766a
- [router] basic mcp support for openai router response api (#10978) · 72392f29
  Keyang Ru authored Sep 27, 2025
  
  72392f29
27 Sep, 2025 7 commits
- [router][tool parser] Modify tool parser to return both normal text and tool... · c1c8dd1d
  Chang Su authored Sep 27, 2025
```
[router][tool parser] Modify tool parser to return both normal text and tool calls (non-stream) (#10995)
```
  c1c8dd1d
- Fix profiler (#10997) · f6bc3f52
  Lianmin Zheng authored Sep 27, 2025
  
  f6bc3f52
- Use jsonschema to constrain required or specific tool choice (#10550) · 8cc27fdc
  Tejesh Anand authored Sep 27, 2025
  
  8cc27fdc
- [PD] Extract the PP transfer layer calculate logic from Mooncake to Common backend (#10565) · 9c339d6b
  Shangming Cai authored Sep 28, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  9c339d6b
- Add support for topk metadata transferring for PD (#10616) · e23e280e
  Shangming Cai authored Sep 28, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  e23e280e
- Add auth to get server info (#10751) · 51f7c6bd
  Muqi Li authored Sep 27, 2025
```
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  51f7c6bd
- fix: make inference deterministic for large TP (#10930) · 62e2e99d
  Xinyuan Tong authored Sep 27, 2025
```
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  62e2e99d