Commits · 1df84ff4148433e589e10833c2ecbdd80a0e7348 · change / sglang

17 Aug, 2025 2 commits
- ci: simplify multi-modality tests by using mixins (#9006) · 1df84ff4
  Mick authored Aug 17, 2025
  
  1df84ff4
- Bug fix: use correct mm_items in embed_mm_inputs (#8893) · 66d6be08
  Binyao Jiang authored Aug 16, 2025
  
  66d6be08
13 Aug, 2025 1 commit
- Double vision prefill throughput by defaulting to optimal vision attention backend (#8484) · 3b3b3baf
  Kevin Xiang Li authored Aug 13, 2025
```
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
```
  3b3b3baf
09 Aug, 2025 2 commits

Support glm4.1v and glm4.5v (#8798) · f29aba8c

Binyao Jiang authored Aug 09, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Chang Su <csu272@usc.edu>

f29aba8c

Fix qwen2 audio not working bug (#8600) · 7b81f956
Binyao Jiang authored Aug 09, 2025

7b81f956

01 Aug, 2025 1 commit

Fix chat template handling for OpenAI serving (#8635) · 7e831efe

Xinyuan Tong authored Jul 31, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

7e831efe

21 Jul, 2025 1 commit
- [Refactor] simplify multimodal data processing (#8107) · 8430bfe3
  Xinyuan Tong authored Jul 20, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8430bfe3
19 Jul, 2025 1 commit
- Feat: Support audio in Phi4-mm model (#8048) · b7e951a6
  Binyao Jiang authored Jul 18, 2025
  
  b7e951a6
10 Jul, 2025 1 commit
- vlm: support video as an input modality (#5888) · b5e3d603
  Mick authored Jul 10, 2025
  
  b5e3d603
08 Jul, 2025 1 commit
- [Multimodal][Perf] Use `pybase64` instead of `base64` (#7724) · a37e1247
  Brayden Zhong authored Jul 08, 2025
  
  a37e1247
05 Jun, 2025 1 commit
- Support LoRA in TestOpenAIVisionServer and fix fused kv_proj loading bug. (#6861) · 4474eaf5
  Lifu Huang authored Jun 04, 2025
  
  4474eaf5
31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
23 May, 2025 1 commit
- [VLM] Support chunk prefill for VLM (#6355) · 4685fbb8
  Chang Su authored May 22, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  4685fbb8
18 May, 2025 1 commit
- Add 4-GPU runner tests and split existing tests (#6383) · f11481b9
  fzyzcjy authored May 19, 2025
  
  f11481b9
17 May, 2025 1 commit
- model(vlm): mistral 3.1 (#5099) · 64825b83
  Kiv Chen authored May 16, 2025
```
Co-authored-by: KivenChen <sleigh-queue-0y@icloud.com>
```
  64825b83
13 May, 2025 1 commit
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
02 May, 2025 1 commit

Support InternVL3 (#5350) · 3409aaab

xm:D authored May 02, 2025


Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>

3409aaab

30 Apr, 2025 2 commits
- [fix] kimi-vl test in test_vision_openai_server.py (#5910) · 3cff9633
  JieXin Liang authored Apr 30, 2025
  
  3cff9633
- [Feature] add support kimi vl model (#5383) · 8fefdd32
  liwenju0 authored Apr 30, 2025
```
Co-authored-by: wenju.li <wenju.li@deepctr.cn>
```
  8fefdd32
29 Apr, 2025 1 commit
- [Feature] support auto chat template (#4949) · 2c3ea294
  woodx authored Apr 29, 2025
  
  2c3ea294
26 Apr, 2025 2 commits

[Fix]: support deepseek-vl2-tiny model (#5552) · 04d0123f
ZXN authored Apr 26, 2025
```
Co-authored-by: bppps <zouyu.zzx@alibaba-inc.com>
```
04d0123f

fix: fix one more bug from merging mm_inputs (#5718) · feda9b11

Mick authored Apr 26, 2025


Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>

feda9b11

24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
23 Apr, 2025 1 commit
- fix gemma3 unit test (#5670) · 8777a1d2
  Yineng Zhang authored Apr 23, 2025
  
  8777a1d2
10 Apr, 2025 1 commit
- Update deps for mllama4 (#5215) · 1078396f
  Ke Bao authored Apr 11, 2025
  
  1078396f
09 Apr, 2025 1 commit
- model: support mllama4 (#5144) · fbebcb7a
  Mick authored Apr 10, 2025
  
  fbebcb7a
31 Mar, 2025 1 commit
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
28 Mar, 2025 1 commit
- test: reduce `mem_fraction_static` for gemma3 vision test (#4840) · 7907f9eb
  Juwan Yoo authored Mar 27, 2025
  
  7907f9eb
26 Mar, 2025 1 commit
- Warn users when release_memory_occupation is called without memory saver enabled (#4566) · 26f07294
  fzyzcjy authored Mar 26, 2025
  
  26f07294
25 Mar, 2025 2 commits
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
23 Mar, 2025 1 commit
- refactor: bug fixes and refactor for vlm (#4661) · 11577ced
  Mick authored Mar 23, 2025
  
  11577ced
18 Mar, 2025 1 commit
- fix: second_per_grid_ts should be used to get mrope position (#3682) · d373a48c
  Mick authored Mar 18, 2025
  
  d373a48c
17 Mar, 2025 2 commits
- [Feature] Support Deepseek-VL2 (#2798) · d6d21640
  萝卜菜 authored Mar 17, 2025
```
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  d6d21640
- Urgent model support: support gemma-3-it (#4424) · 9d02bb3e
  Mick authored Mar 17, 2025
  
  9d02bb3e
13 Mar, 2025 1 commit
- Fix auto merge & add back get_flat_data_by_layer (#4393) · a5a892ff
  Lianmin Zheng authored Mar 13, 2025
  
  a5a892ff
12 Mar, 2025 1 commit
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
11 Mar, 2025 1 commit
- refactor: move image processors to separate files (#4229) · ff2ce0b8
  Mick authored Mar 12, 2025
  
  ff2ce0b8
25 Feb, 2025 1 commit
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde