Commits · f2a75a66c4e5bd007ce0eabd4fb16edade751e6c · change / sglang

11 Jun, 2025 3 commits
- update doc (#7046) · f2a75a66
  Ximingwang-09 authored Jun 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  f2a75a66
- Do not run frontend_reasoning.ipynb to reduce the CI load (#7073) · 0f218731
  Lianmin Zheng authored Jun 10, 2025
  
  0f218731
- Frontend language separate reasoning support (#6031) · 14c18d25
  Yudi Xue authored Jun 10, 2025
  
  14c18d25
10 Jun, 2025 4 commits
- Improve perf tuning docs (#7071) · 90bd3e32
  Lianmin Zheng authored Jun 10, 2025
  
  90bd3e32
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
- Update README.md (#7040) · bb185b0e
  Lianmin Zheng authored Jun 10, 2025
  
  bb185b0e
- chore: bump v0.4.7 (#7038) · 4f723edd
  Yineng Zhang authored Jun 10, 2025
  
  4f723edd
09 Jun, 2025 1 commit
- Fix torch profiler bugs for bench_offline_throughput.py (#6557) · 98c00a2d
  Yueyang Pan authored Jun 09, 2025
  
  98c00a2d
06 Jun, 2025 1 commit
- AITER backend extension and workload optimizations (#6838) · b819381f
  HAI authored Jun 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  b819381f
05 Jun, 2025 2 commits
- [PD] Fix potential perf spike caused by tracker gc and optimize doc (#6764) · dd1012fc
  shangmingc authored Jun 06, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  dd1012fc
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 2 commits
- [Refactor] Multimodal data processing for VLM (#6659) · cf9815ba
  Xinyuan Tong authored Jun 04, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  cf9815ba
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
30 May, 2025 1 commit
- [PD] Optimize time out logic and add env var doc for mooncake (#6761) · 6cb00c63
  shangmingc authored May 30, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6cb00c63
28 May, 2025 1 commit
- [Feature] Support Flashinfer fp8 blockwise GEMM kernel on Blackwell (#6479) · 791b3bfa
  Baizhou Zhang authored May 28, 2025
  
  791b3bfa
27 May, 2025 4 commits
- [PD] Make bootstrap code common between NIXL and Mooncake (#6473) · e806f708
  Trevor Morris authored May 27, 2025
  
  e806f708
- docs: Update documentation to reflect xgrammar as default grammar backend (#6601) · 45a31a82
  Vincent Zhong authored May 27, 2025
```
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
```
  45a31a82
- Add note to add supported model to documentation (#6640) · 1aa0fbf4
  Brayden Zhong authored May 27, 2025
  
  1aa0fbf4
- update toc for doc and dockerfile code style format (#6450) · 7a0bbe6a
  linzhuo authored May 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  7a0bbe6a
26 May, 2025 1 commit
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
25 May, 2025 1 commit
- Fix some issues with current docs. (#6588) · e235be16
  simveit authored May 25, 2025
  
  e235be16
24 May, 2025 2 commits
- chore: bump v0.4.6.post5 (#6566) · 7e257cd6
  Yineng Zhang authored May 24, 2025
  
  7e257cd6
- feat(Tool Calling): Support `required` and specific function mode (#6550) · ed0c3035
  Chang Su authored May 23, 2025
  
  ed0c3035
22 May, 2025 2 commits
- Support XiaomiMiMo inference with mtp (#6059) · a6ae3af1
  ryang authored May 23, 2025
  
  a6ae3af1
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
20 May, 2025 2 commits
- [docs] Fix torch version (#6472) · 66324895
  Wenxuan Tan authored May 20, 2025
  
  66324895
- Expert distribution recording without overhead for EPLB (#4957) · f0653886
  fzyzcjy authored May 20, 2025
  
  f0653886
19 May, 2025 1 commit
- Improve supported models doc (#6430) · 506e5de8
  simveit authored May 19, 2025
  
  506e5de8
18 May, 2025 1 commit
- Add missing model to doc (#6396) · 6dc6b306
  applesaucethebun authored May 18, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  6dc6b306
17 May, 2025 2 commits
- docs: Update the MD files (#6373) · e9ef39d2
  Vincent Zhong authored May 17, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  e9ef39d2
- model(vlm): mistral 3.1 (#5099) · 64825b83
  Kiv Chen authored May 16, 2025
```
Co-authored-by: KivenChen <sleigh-queue-0y@icloud.com>
```
  64825b83
16 May, 2025 1 commit
- Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136) · f19a9204
  Yury Sulsky authored May 16, 2025
```
Co-authored-by: Yury Sulsky <ysulsky@tesla.com>
```
  f19a9204
15 May, 2025 1 commit

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) · 2e4babdb

quinnrong94 authored May 15, 2025


Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>