Commits · b7cd743038f58ef6a5b183a912211622a63db359 · change / sglang · GitLab

07 Aug, 2025 1 commit
- [Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949) · b7cd7430
  PGFLMG authored Aug 07, 2025
  
  b7cd7430
06 Aug, 2025 1 commit
- [Feature] improve TBO: two chunk overlap (#8144) · ca47e24f
  HouseWest authored Aug 06, 2025
  
  ca47e24f
04 Aug, 2025 1 commit
- Rename lora_path to lora_id in batches (#8437) · f2d68ded
  Baizhou Zhang authored Aug 03, 2025
  
  f2d68ded
03 Aug, 2025 1 commit
- [CUDA Graph] save cuda graph memory by using next_token_logits_buffer (#8579) · cb099d20
  Cheng Wan authored Aug 03, 2025
  
  cb099d20
01 Aug, 2025 1 commit
- [5/N] MoE Refactor: Update MoE parallelism arguments (#8658) · 6c88f6c8
  Cheng Wan authored Aug 01, 2025
  
  6c88f6c8
28 Jul, 2025 1 commit
- [3/N] MoE Refactor: Simplify DeepEP Output (#8421) · 9c138a04
  Cheng Wan authored Jul 28, 2025
  
  9c138a04
25 Jul, 2025 2 commits
- DP Enhancement (#8280) · c0fb25e9
  Cheng Wan authored Jul 24, 2025
  
  c0fb25e9
- support idle batch for TBO (#8233) · f4674df6
  ZhichenJiang authored Jul 25, 2025
  
  f4674df6
16 Jul, 2025 1 commit

[Feature] Layer-wise Prefill (#7634) · 570d3343

Xiaoze Fan authored Jul 17, 2025


Signed-off-by: jason-fxz <jason341132@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

570d3343

08 Jul, 2025 1 commit
- [Bugfix] Fix two batch overlap with auto DeepEP Dispatch (#7853) · d379bda4
  Shangming Cai authored Jul 08, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d379bda4
06 Jul, 2025 1 commit
- Support logprobs in two-batch overlap (#7709) · a291439a
  fzyzcjy authored Jul 06, 2025
  
  a291439a
05 Jul, 2025 1 commit
- DP Attention with Auto DeepEP Dispatch (#7222) · 8fc910db
  Cheng Wan authored Jul 05, 2025
  
  8fc910db
27 Jun, 2025 1 commit
- feat: support compatibility between MTP and two-batch-overlap (#7225) · 41650b0d
  Qiaolin Yu authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  41650b0d
25 Jun, 2025 1 commit
- Fix gathered_buffer issues in tbo (#7531) · b8df43ab
  Qiaolin Yu authored Jun 25, 2025
  
  b8df43ab
14 Jun, 2025 1 commit
- Refactor DeepGEMM integration (#7150) · b4c41f72
  fzyzcjy authored Jun 14, 2025
  
  b4c41f72
08 Jun, 2025 2 commits
- Remove unnecessary kernels of num_token_non_padded (#6965) · 2fc12995
  fzyzcjy authored Jun 08, 2025
  
  2fc12995
- Slightly improve the sampler to skip unnecessary steps (#6956) · 608668e1
  Lianmin Zheng authored Jun 08, 2025
  
  608668e1
28 May, 2025 2 commits
- Speed up when having padding tokens two-batch overlap (#6668) · 31589e17
  fzyzcjy authored May 29, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  31589e17
- Minor refactor two-batch overlap (#6682) · ae6a5b29
  fzyzcjy authored May 29, 2025
  
  ae6a5b29
27 May, 2025 2 commits
- Fix qwen3 tbo/dp-lm-head (#6652) · b18416fb
  Yi Zhang authored May 27, 2025
  
  b18416fb
- Support TP in attention for two batch overlap (#6634) · 32cd7070
  fzyzcjy authored May 27, 2025
  
  32cd7070
26 May, 2025 3 commits
- qwen3moe support two batch overlap (#6598) · f9bab3d5
  Yi Zhang authored May 26, 2025
  
  f9bab3d5
- Logging and minor fixes to two batch overlap and EPLB (#6595) · 93e53f6e
  fzyzcjy authored May 26, 2025
  
  93e53f6e
- Improve performance of two batch overlap in some imbalanced cases (#6593) · a191a0e4
  fzyzcjy authored May 26, 2025
  
  a191a0e4
25 May, 2025 1 commit
- Support overlapping two batches (#4068) · 0d477880
  fzyzcjy authored May 25, 2025
  
  0d477880