Commits · a071dc4084ea08aea1ab2fe96baace67b5f29b5f · change / sglang

20 May, 2025 1 commit
- Support dispatching logical to physical experts (#6385) · e98afbe0
  fzyzcjy authored May 20, 2025
  
  e98afbe0
18 May, 2025 3 commits
- vlm: tensor hash kernel (#5974) · 626ccb7d
  Mick authored May 19, 2025
  
  626ccb7d
- refactor: minor refactors regarding multimodal processing (#6187) · 01dd39ba
  Mick authored May 18, 2025
  
  01dd39ba
- Support custom DeepEP tuning config (#6257) · fd08c048
  fzyzcjy authored May 18, 2025
  
  fd08c048
16 May, 2025 1 commit
- Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136) · f19a9204
  Yury Sulsky authored May 16, 2025
```
Co-authored-by: Yury Sulsky <ysulsky@tesla.com>
```
  f19a9204
12 May, 2025 2 commits
- Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225) · d18c6b33
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d18c6b33
- Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558) · 25c83fff
  Cheng Wan authored May 12, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
```
  25c83fff
11 May, 2025 4 commits
- Improve structured outputs: fix race condition, server crash, metrics and style (#6188) · 01bdbf7f
  Lianmin Zheng authored May 11, 2025
  
  01bdbf7f
- fix: handle None multimodal_inputs during merging and filtering batches in... · 41273fd7
  Yusong Gao authored May 11, 2025
```
fix: handle None multimodal_inputs during merging and filtering batches in disaggregation decode mode (#6169)
```
  41273fd7
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
- Fix request abortion (#6184) · de167cf5
  Lianmin Zheng authored May 10, 2025
  
  de167cf5
09 May, 2025 1 commit
- [Fix] Incorrect Memory Allocation on CUDA:0 by Non-Zero CUDA Processes in TP/DP (#5745) · cec98f10
  yhyang201 authored May 09, 2025
  
  cec98f10
01 May, 2025 1 commit
- [PP] Add pipeline parallelism (#5724) · 11383cec
  Ying Sheng authored Apr 30, 2025
  
  11383cec
28 Apr, 2025 2 commits
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4
- Improve overlap scheduling (#5788) · 40d9b8ac
  Liangsheng Yin authored Apr 28, 2025
  
  40d9b8ac
26 Apr, 2025 2 commits
- Bugfix for minicpmo vision test (#5760) · 1f963d7f
  Yi Zhang authored Apr 26, 2025
  
  1f963d7f
- fix: fix one more bug from merging mm_inputs (#5718) · feda9b11
  Mick authored Apr 26, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>
```
  feda9b11
25 Apr, 2025 1 commit
- [PD]: Support Muti Prefill in one node (#5704) · 11e27d09
  IAN authored Apr 26, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  11e27d09
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
21 Apr, 2025 2 commits
- [PD] Support prefill overlap + Ensure no race condition (#5609) · bf98d2e3
  Byron Hsu authored Apr 21, 2025
  
  bf98d2e3
- upstream hicache fixes (#5570) · 70645f4d
  Zhiqiang Xie authored Apr 20, 2025
  
  70645f4d
19 Apr, 2025 1 commit
- simplify the control logic for using shared experts fusion (#5504) · d58e3544
  Xiaoyu Zhang authored Apr 20, 2025
  
  d58e3544
18 Apr, 2025 1 commit
- Introduce moe_dense_tp_size to fix dense layer errors in DeepSeek V3 + 4x8xH100 (#4836) · 53dcf388
  fzyzcjy authored Apr 18, 2025
  
  53dcf388
17 Apr, 2025 2 commits
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
- Deprecate disable-mla (#5481) · 4fb05583
  Baizhou Zhang authored Apr 17, 2025
  
  4fb05583
16 Apr, 2025 1 commit
- Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) · a42736bb
  Baizhou Zhang authored Apr 15, 2025
  
  a42736bb
13 Apr, 2025 1 commit
- [PD] Add transfer backend abstraction (#5328) · a9499885
  Byron Hsu authored Apr 13, 2025
  
  a9499885
12 Apr, 2025 1 commit
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
11 Apr, 2025 1 commit
- [fix] fix mrope positions not picked up (#5265) · e53a0b3d
  Mick authored Apr 11, 2025
  
  e53a0b3d
10 Apr, 2025 2 commits

[PD] Support KV transfer with mooncake (#4880) · 4c31ae9f

Teng Ma authored Apr 10, 2025


Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: shangmingc <csmthu@gmail.com>

4c31ae9f

[metrics] Add in queue metrics (#4444) · 5db37c86
Stefan He authored Apr 09, 2025

5db37c86

09 Apr, 2025 2 commits
- model: support mllama4 (#5144) · fbebcb7a
  Mick authored Apr 10, 2025
  
  fbebcb7a
- Fix multimodal hashing error (#5174) · 466899e6
  fzyzcjy authored Apr 09, 2025
  
  466899e6
08 Apr, 2025 1 commit
- fix multimodal hash feature (#5083) · 27f8e6b9
  huangtingwei authored Apr 08, 2025
  
  27f8e6b9
05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
04 Apr, 2025 1 commit
- Add DeepSeek V3/R1 shared experts fusion (#4918) · 924ca7c9
  Xiaoyu Zhang authored Apr 04, 2025
  
  924ca7c9
03 Apr, 2025 2 commits
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
01 Apr, 2025 2 commits
- Prevent memory leak of retract_decode when page_size > 1 (#4977) · 12047f5e
  Zhiqiang Xie authored Apr 01, 2025
  
  12047f5e
- [Feature] Support DeepEP Low Latency (#4767) · 23c764b1
  Jinyan Chen authored Apr 02, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  23c764b1