Commits · 7a0bbe6a64ee61f0bd22811a3b72bc7418e15c17 · change / sglang · GitLab

27 May, 2025 1 commit
- update toc for doc and dockerfile code style format (#6450) · 7a0bbe6a
  linzhuo authored May 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  7a0bbe6a
26 May, 2025 1 commit
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
25 May, 2025 1 commit
- Fix some issues with current docs. (#6588) · e235be16
  simveit authored May 25, 2025
  
  e235be16
24 May, 2025 2 commits
- chore: bump v0.4.6.post5 (#6566) · 7e257cd6
  Yineng Zhang authored May 24, 2025
  
  7e257cd6
- feat(Tool Calling): Support `required` and specific function mode (#6550) · ed0c3035
  Chang Su authored May 23, 2025
  
  ed0c3035
22 May, 2025 2 commits
- Support XiaomiMiMo inference with mtp (#6059) · a6ae3af1
  ryang authored May 23, 2025
  
  a6ae3af1
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
20 May, 2025 2 commits
- [docs] Fix torch version (#6472) · 66324895
  Wenxuan Tan authored May 20, 2025
  
  66324895
- Expert distribution recording without overhead for EPLB (#4957) · f0653886
  fzyzcjy authored May 20, 2025
  
  f0653886
19 May, 2025 1 commit
- Improve supported models doc (#6430) · 506e5de8
  simveit authored May 19, 2025
  
  506e5de8
18 May, 2025 1 commit
- Add missing model to doc (#6396) · 6dc6b306
  applesaucethebun authored May 18, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  6dc6b306
17 May, 2025 2 commits
- docs: Update the MD files (#6373) · e9ef39d2
  Vincent Zhong authored May 17, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  e9ef39d2
- model(vlm): mistral 3.1 (#5099) · 64825b83
  Kiv Chen authored May 16, 2025
```
Co-authored-by: KivenChen <sleigh-queue-0y@icloud.com>
```
  64825b83
16 May, 2025 1 commit
- Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136) · f19a9204
  Yury Sulsky authored May 16, 2025
```
Co-authored-by: Yury Sulsky <ysulsky@tesla.com>
```
  f19a9204
15 May, 2025 1 commit

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) · 2e4babdb

quinnrong94 authored May 15, 2025


Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>

2e4babdb

14 May, 2025 2 commits

docs: fix a bad redirect (#6300) · 9a91fa0e
Brayden Zhong authored May 14, 2025

9a91fa0e

doc: update developer guide regarding mllms (#6138) · cd7c8a8d

Mick authored May 14, 2025

Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>

cd7c8a8d

13 May, 2025 3 commits
- chore: bump v0.4.6.post4 (#6245) · 16267d4f
  Yineng Zhang authored May 13, 2025
  
  16267d4f
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
- [Llama4] Add docs note about enable multimodal (#6235) · 3c32895c
  Brayden Zhong authored May 12, 2025
  
  3c32895c
12 May, 2025 4 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [Docs] Add docs for `SGLANG_` and `SGL_` environment variables (#6206) · 12319a67
  Brayden Zhong authored May 12, 2025
  
  12319a67
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558) · 25c83fff
  Cheng Wan authored May 12, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
```
  25c83fff
11 May, 2025 4 commits
- Improve structured outputs: fix race condition, server crash, metrics and style (#6188) · 01bdbf7f
  Lianmin Zheng authored May 11, 2025
  
  01bdbf7f
- [Docs] minor Qwen3 and reasoning parser docs fix (#6032) · 94d42b67
  Adarsh Shirawalmath authored May 11, 2025
  
  94d42b67
- doc: fix the erroneous documents and example codes about... · 69276f61
  mlmz authored May 11, 2025
```
doc: fix the erroneous documents and example codes about Alibaba-NLP/gme-Qwen2-VL-2B-Instruct (#6199)
```
  69276f61
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
10 May, 2025 3 commits
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
- [Docs]Delete duplicate content (#6146) · 921e4a81
  Ximingwang-09 authored May 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  921e4a81
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
09 May, 2025 2 commits
- chore: bump v0.4.6.post3 (#6165) · 678d8cc9
  Yineng Zhang authored May 09, 2025
  
  678d8cc9
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
08 May, 2025 2 commits
- [Feature] Add FlashAttention3 as a backend for VisionAttention (#5764) · fa7d7fd9
  Zhu Chen authored May 09, 2025
```
Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  fa7d7fd9
- Update doc for MLA attention backends (#6034) · 8f508cc7
  Baizhou Zhang authored May 07, 2025
  
  8f508cc7
07 May, 2025 1 commit
- [Doc]Fix description for dp_size argument (#6063) · fee37d9e
  Baizhou Zhang authored May 07, 2025
  
  fee37d9e
05 May, 2025 3 commits
- feat: append more comprehensive fields in messages instead of merely role and content (#5996) · a68ed766
  mlmz authored May 06, 2025
  
  a68ed766
- Fix "Avoid computing lse in Ragged Prefill when there's no prefix match" (#5555) · 22da3d97
  Wenxuan Tan authored May 05, 2025
  
  22da3d97
- Update dev container config to support live code sync and improve docker setup guide (#6018) · 1232f7e8
  Lifu Huang authored May 04, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  1232f7e8
04 May, 2025 1 commit
- Tool Call: Add `chat_template_kwargs` documentation (#5679) · 95c231e5
  vzed authored May 04, 2025
  
  95c231e5