Commits · 4474eaf5528aa073ce5ea6dc8c4136dc2b8f7449 · change / sglang

05 Jun, 2025 1 commit
- Support LoRA in TestOpenAIVisionServer and fix fused kv_proj loading bug. (#6861) · 4474eaf5
  Lifu Huang authored Jun 04, 2025
  
  4474eaf5
31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
23 May, 2025 1 commit
- [VLM] Support chunk prefill for VLM (#6355) · 4685fbb8
  Chang Su authored May 22, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  4685fbb8
18 May, 2025 1 commit
- Add 4-GPU runner tests and split existing tests (#6383) · f11481b9
  fzyzcjy authored May 19, 2025
  
  f11481b9
17 May, 2025 1 commit
- model(vlm): mistral 3.1 (#5099) · 64825b83
  Kiv Chen authored May 16, 2025
```
Co-authored-by: KivenChen <sleigh-queue-0y@icloud.com>
```
  64825b83
13 May, 2025 1 commit
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
02 May, 2025 1 commit

xm:D authored May 02, 2025


Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>

3409aaab

30 Apr, 2025 2 commits
- [fix] kimi-vl test in test_vision_openai_server.py (#5910) · 3cff9633
  JieXin Liang authored Apr 30, 2025
  
  3cff9633
- [Feature] add support kimi vl model (#5383) · 8fefdd32
  liwenju0 authored Apr 30, 2025
```
Co-authored-by: wenju.li <wenju.li@deepctr.cn>
```
  8fefdd32
29 Apr, 2025 1 commit
- [Feature] support auto chat template (#4949) · 2c3ea294
  woodx authored Apr 29, 2025
  
  2c3ea294
26 Apr, 2025 2 commits

[Fix]: support deepseek-vl2-tiny model (#5552) · 04d0123f
ZXN authored Apr 26, 2025
```
Co-authored-by: bppps <zouyu.zzx@alibaba-inc.com>
```
04d0123f

fix: fix one more bug from merging mm_inputs (#5718) · feda9b11

Mick authored Apr 26, 2025


Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>

feda9b11

24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
23 Apr, 2025 1 commit
- fix gemma3 unit test (#5670) · 8777a1d2
  Yineng Zhang authored Apr 23, 2025
  
  8777a1d2
10 Apr, 2025 1 commit
- Update deps for mllama4 (#5215) · 1078396f
  Ke Bao authored Apr 11, 2025
  
  1078396f
09 Apr, 2025 1 commit
- model: support mllama4 (#5144) · fbebcb7a
  Mick authored Apr 10, 2025
  
  fbebcb7a
31 Mar, 2025 1 commit
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
28 Mar, 2025 1 commit
- test: reduce `mem_fraction_static` for gemma3 vision test (#4840) · 7907f9eb
  Juwan Yoo authored Mar 27, 2025
  
  7907f9eb
26 Mar, 2025 1 commit
- Warn users when release_memory_occupation is called without memory saver enabled (#4566) · 26f07294
  fzyzcjy authored Mar 26, 2025
  
  26f07294
25 Mar, 2025 2 commits
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
23 Mar, 2025 1 commit
- refactor: bug fixes and refactor for vlm (#4661) · 11577ced
  Mick authored Mar 23, 2025
  
  11577ced
18 Mar, 2025 1 commit
- fix: second_per_grid_ts should be used to get mrope position (#3682) · d373a48c
  Mick authored Mar 18, 2025
  
  d373a48c
17 Mar, 2025 2 commits
- [Feature] Support Deepseek-VL2 (#2798) · d6d21640
  萝卜菜 authored Mar 17, 2025
```
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  d6d21640
- Urgent model support: support gemma-3-it (#4424) · 9d02bb3e
  Mick authored Mar 17, 2025
  
  9d02bb3e
13 Mar, 2025 1 commit
- Fix auto merge & add back get_flat_data_by_layer (#4393) · a5a892ff
  Lianmin Zheng authored Mar 13, 2025
  
  a5a892ff
12 Mar, 2025 1 commit
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
11 Mar, 2025 1 commit
- refactor: move image processors to separate files (#4229) · ff2ce0b8
  Mick authored Mar 12, 2025
  
  ff2ce0b8
25 Feb, 2025 1 commit
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde
16 Feb, 2025 1 commit
- Model: Support Qwen 2.5 vl (#3258) · bcc213df
  Mick authored Feb 16, 2025
  
  bcc213df
28 Jan, 2025 1 commit
- [Fix] Address remaining issues of supporting MiniCPMV (#2977) · 9f635ea5
  Mick authored Jan 28, 2025
  
  9f635ea5
19 Jan, 2025 1 commit
- Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956) · 4d4cdb3f
  Chang Su authored Jan 18, 2025
  
  4d4cdb3f
18 Jan, 2025 1 commit

[Feature] Support minicpmv v2.6 (#2785) · 3d93f84a

Mick authored Jan 19, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>

3d93f84a

28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
22 Nov, 2024 1 commit
- Fix #2037 - Context length check does not take into out pad tokens for visual models (#2106) · 8048c28c
  Jake Poznanski authored Nov 21, 2024
  
  8048c28c
03 Nov, 2024 1 commit
- Simplify tokenizer manager (#1904) · c17c5781
  Lianmin Zheng authored Nov 03, 2024
  
  c17c5781
02 Nov, 2024 1 commit
- Improve docs and fix the broken links (#1875) · d1b31b06
  Lianmin Zheng authored Nov 01, 2024
  
  d1b31b06
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
21 Oct, 2024 1 commit
- Llama3.2 vision model support (#1551) · 94cde109
  Liangsheng Yin authored Oct 21, 2024
  
  94cde109