Commits · 72676cd6c0eead68286cf9c8df5c67f580ff477b · change / sglang

21 Jun, 2025 2 commits
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
- Remove batches api in docs & example (#7400) · ab74f8f0
  Jinn authored Jun 20, 2025
  
  ab74f8f0
20 Jun, 2025 1 commit
- [Doc] add embedding rerank doc (#7364) · 97011abc
  woodx authored Jun 20, 2025
  
  97011abc
17 Jun, 2025 1 commit
- support qwen2 running on ascend npu device (#7022) · a39d9287
  Yijie Zhu authored Jun 18, 2025
```
Co-authored-by: 刁莹煜 <diaoyingyu1@hisilicon.com>
```
  a39d9287
16 Jun, 2025 1 commit
- Minor style and doc fix (#7228) · 21615cc3
  Lianmin Zheng authored Jun 16, 2025
  
  21615cc3
12 Jun, 2025 1 commit
- [Fix] Reduce busy polling when scheduler is idle (#6026) · bd7cfbd2
  Povilas Kanapickas authored Jun 13, 2025
  
  bd7cfbd2
11 Jun, 2025 2 commits
- Clean up docs for server args and sampling parameters (generated by grok) (#7076) · dbdf76ca
  Lianmin Zheng authored Jun 10, 2025
  
  dbdf76ca
- update doc (#7046) · f2a75a66
  Ximingwang-09 authored Jun 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  f2a75a66
10 Jun, 2025 2 commits
- Improve perf tuning docs (#7071) · 90bd3e32
  Lianmin Zheng authored Jun 10, 2025
  
  90bd3e32
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
05 Jun, 2025 2 commits
- [PD] Fix potential perf spike caused by tracker gc and optimize doc (#6764) · dd1012fc
  shangmingc authored Jun 06, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  dd1012fc
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 2 commits
- [Refactor] Multimodal data processing for VLM (#6659) · cf9815ba
  Xinyuan Tong authored Jun 04, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  cf9815ba
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
30 May, 2025 1 commit
- [PD] Optimize time out logic and add env var doc for mooncake (#6761) · 6cb00c63
  shangmingc authored May 30, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6cb00c63
27 May, 2025 3 commits
- [PD] Make bootstrap code common between NIXL and Mooncake (#6473) · e806f708
  Trevor Morris authored May 27, 2025
  
  e806f708
- docs: Update documentation to reflect xgrammar as default grammar backend (#6601) · 45a31a82
  Vincent Zhong authored May 27, 2025
```
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
```
  45a31a82
- update toc for doc and dockerfile code style format (#6450) · 7a0bbe6a
  linzhuo authored May 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  7a0bbe6a
25 May, 2025 1 commit
- Fix some issues with current docs. (#6588) · e235be16
  simveit authored May 25, 2025
  
  e235be16
24 May, 2025 1 commit
- feat(Tool Calling): Support `required` and specific function mode (#6550) · ed0c3035
  Chang Su authored May 23, 2025
  
  ed0c3035
22 May, 2025 2 commits
- Support XiaomiMiMo inference with mtp (#6059) · a6ae3af1
  ryang authored May 23, 2025
  
  a6ae3af1
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
20 May, 2025 1 commit
- Expert distribution recording without overhead for EPLB (#4957) · f0653886
  fzyzcjy authored May 20, 2025
  
  f0653886
16 May, 2025 1 commit
- Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136) · f19a9204
  Yury Sulsky authored May 16, 2025
```
Co-authored-by: Yury Sulsky <ysulsky@tesla.com>
```
  f19a9204
15 May, 2025 1 commit

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) · 2e4babdb

quinnrong94 authored May 15, 2025


Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>

2e4babdb

14 May, 2025 1 commit
- docs: fix a bad redirect (#6300) · 9a91fa0e
  Brayden Zhong authored May 14, 2025
  
  9a91fa0e
12 May, 2025 3 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558) · 25c83fff
  Cheng Wan authored May 12, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
```
  25c83fff
11 May, 2025 4 commits
- Improve structured outputs: fix race condition, server crash, metrics and style (#6188) · 01bdbf7f
  Lianmin Zheng authored May 11, 2025
  
  01bdbf7f
- [Docs] minor Qwen3 and reasoning parser docs fix (#6032) · 94d42b67
  Adarsh Shirawalmath authored May 11, 2025
  
  94d42b67
- doc: fix the erroneous documents and example codes about... · 69276f61
  mlmz authored May 11, 2025
```
doc: fix the erroneous documents and example codes about Alibaba-NLP/gme-Qwen2-VL-2B-Instruct (#6199)
```
  69276f61
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
10 May, 2025 3 commits
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
- [Docs]Delete duplicate content (#6146) · 921e4a81
  Ximingwang-09 authored May 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  921e4a81
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
09 May, 2025 1 commit
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
08 May, 2025 2 commits
- [Feature] Add FlashAttention3 as a backend for VisionAttention (#5764) · fa7d7fd9
  Zhu Chen authored May 09, 2025
```
Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  fa7d7fd9
- Update doc for MLA attention backends (#6034) · 8f508cc7
  Baizhou Zhang authored May 07, 2025
  
  8f508cc7