Commits · d736e0b65e0f7d0272de3fa4a5c911c1bc1ad3a9 · zhaoyu6 / sglang · GitLab

04 Oct, 2025 3 commits
- [router] add grpc router pd mode for chat and generate (#11140) · d736e0b6
  Simo Lin authored Oct 04, 2025
  
  d736e0b6
- [fix]enable flashmla when using draft model P/D attention select (#11012) · 666da3d5
  Hank Han authored Oct 04, 2025
  
  666da3d5
- fix sampling_seed handling when deterministic is enabled (#11096) · d01b9214
  Alex Chi Z authored Oct 03, 2025
```
Signed-off-by: Alex Chi <iskyzh@gmail.com>
```
  d01b9214
03 Oct, 2025 18 commits
- fix self.enable_kv_cache_events (#11178) · c61b9a1d
  narutolhy authored Oct 03, 2025
  
  c61b9a1d
- [fix]missing prefix_lens_cpu init when p/d disaggregation (#11196) · 3c3d6255
  Hank Han authored Oct 04, 2025
  
  3c3d6255
- [Fix] Fix the bug of the calculation of base_gpu_id (dp offset) in... · 546914fa
  XSongQ authored Oct 03, 2025
```
[Fix] Fix the bug of the calculation of base_gpu_id (dp offset) in data_parallel_controller.py (#10741)
```
  546914fa
- model: support starcoder2 (#10609) · fad7ca73
  Praneth Paruchuri authored Oct 03, 2025
  
  fad7ca73
- fix 3fs indices (#10855) · 08af8ffb
  pansicheng authored Oct 04, 2025
  
  08af8ffb
- Optimize debug log position of PD abort request (#11090) · 2c7f4ca2
  Shangming Cai authored Oct 03, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  2c7f4ca2
- Fix [test]: Env:SGLANG_TORCH_PROFILER_DIR for pytest. (#10780) · 03def5e3
  shubham singhal authored Oct 03, 2025
  
  03def5e3
- Fix CUDA illegal memory access issues in speculative decoding (#10892) · 6ae3f05b
  ur4t authored Oct 03, 2025
  
  6ae3f05b
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
- [hot-fix] Fix CI break which caused by adding `thinking_mode` in eval (#11192) · 04b86b3c
  Liangsheng Yin authored Oct 03, 2025
  
  04b86b3c
- Add --thinking-mode to run_eval (#11189) · d6777a70
  hlu1 authored Oct 03, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  d6777a70
- [Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873) · 8c574902
  Matt Nappo authored Oct 03, 2025
```
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
```
  8c574902
- fix: radix cache memory accounting (#10637) · 1a31229c
  Alex Chi Z authored Oct 03, 2025
```
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
```
  1a31229c
- [CI]] Tee server logs to both file and stdout/stderr using PIPE (#11185) · de89ef49
  Liangsheng Yin authored Oct 03, 2025
  
  de89ef49
- [Fix] Update to v0.1.5.post4 and refine HIP attention backend selection (#11161) · b00a0c78
  jacky.cheng authored Oct 03, 2025
  
  b00a0c78
- [1/n] Enable DCA CUDA graph capture (#9537) · a2faf894
  b8zhong authored Oct 02, 2025
  
  a2faf894
- [Generative Scores API] add performance tests to CICD (#10830) · 7e61737d
  Vedant V Jhaveri authored Oct 02, 2025
  
  7e61737d
- Introduce naming convention in `io_struct` and base sglang io classes. (#10133) · 3c699772
  Liangsheng Yin authored Oct 03, 2025
  
  3c699772
02 Oct, 2025 19 commits
- Allow use of TRTLLM_MHA backend for hybrid attention on Blackwell (#11138) · e8100774
  Dom Brown authored Oct 03, 2025
  
  e8100774
- [router][grpc] Support streaming for v1/chat/completions (#11179) · 963175d5
  Chang Su authored Oct 02, 2025
  
  963175d5
- Minor fixes for server_args, parallel_state, and test_deterministic.py (#11159) · 6a261aac
  Lianmin Zheng authored Oct 02, 2025
  
  6a261aac
- Remove dp balance metadata and minimul token balance. (#11170) · 7ff740a6
  Liangsheng Yin authored Oct 03, 2025
  
  7ff740a6
- [grpc] style fix for grpc compilation. (#11175) · bfcd9b24
  Liangsheng Yin authored Oct 03, 2025
  
  bfcd9b24
- Unify forward output datastructure (#11124) · 458611de
  Liangsheng Yin authored Oct 03, 2025
  
  458611de
- [proto] Add script to compile python protos (#11171) · 3511b370
  Chang Su authored Oct 02, 2025
  
  3511b370
- Tiny remove duplicated code (#11164) · afcd3e10
  fzyzcjy authored Oct 02, 2025
  
  afcd3e10
- Tiny fix ep_gather behavior different in CI (#11130) · 12d68183
  fzyzcjy authored Oct 02, 2025
  
  12d68183
- Tiny cleanup deepseek_v2.py (#11163) · b65db028
  fzyzcjy authored Oct 02, 2025
  
  b65db028
- fix cpp JIT compilation issue of ngram speculative decoding (#10837) · 948278f1
  b8zhong authored Oct 02, 2025
  
  948278f1
- Clean up ascend allocator (#11152) · 7d004799
  Liangsheng Yin authored Oct 02, 2025
  
  7d004799
- [model] Add mamba2 and Falcon-H1 support. (#10988) · 083629c2
  ilyasch2 authored Oct 02, 2025
```
Co-authored-by: Younes Belkada <younes.belkada@tii.ae>
Co-authored-by: Younes B <49240599+younesbelkada@users.noreply.github.com>
```
  083629c2
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
- Support dispatch low latency (#10263) · 0b9dfba7
  fzyzcjy authored Oct 02, 2025
```
Co-authored-by: Kaixi Hou <4001424+kaixih@users.noreply.github.com>
```
  0b9dfba7
- Remove unused pack `.item()` in paged allocator. (#11156) · 6a290034
  Liangsheng Yin authored Oct 02, 2025
  
  6a290034
- Tiny detect slow ranks (#10508) · 2ac453b0
  fzyzcjy authored Oct 02, 2025
  
  2ac453b0
- Fuse quantize and rope in trtllm_mla MTP (#10779) · f35def86
  fzyzcjy authored Oct 02, 2025
  
  f35def86
- Tiny fix missing alt stream in nextn layer (#10768) · d61615fe
  fzyzcjy authored Oct 02, 2025
  
  d61615fe