Commits · 87eddedfa2d92ed8301fa3d7edd5eea7672bb1ac · change / sglang

31 Mar, 2025 1 commit
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
28 Mar, 2025 1 commit
- test: reduce `mem_fraction_static` for gemma3 vision test (#4840) · 7907f9eb
  Juwan Yoo authored Mar 27, 2025
  
  7907f9eb
26 Mar, 2025 1 commit
- Warn users when release_memory_occupation is called without memory saver enabled (#4566) · 26f07294
  fzyzcjy authored Mar 26, 2025
  
  26f07294
25 Mar, 2025 2 commits
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
23 Mar, 2025 1 commit
- refactor: bug fixes and refactor for vlm (#4661) · 11577ced
  Mick authored Mar 23, 2025
  
  11577ced
18 Mar, 2025 1 commit
- fix: second_per_grid_ts should be used to get mrope position (#3682) · d373a48c
  Mick authored Mar 18, 2025
  
  d373a48c
17 Mar, 2025 2 commits
- [Feature] Support Deepseek-VL2 (#2798) · d6d21640
  萝卜菜 authored Mar 17, 2025
```
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  d6d21640
- Urgent model support: support gemma-3-it (#4424) · 9d02bb3e
  Mick authored Mar 17, 2025
  
  9d02bb3e
13 Mar, 2025 1 commit
- Fix auto merge & add back get_flat_data_by_layer (#4393) · a5a892ff
  Lianmin Zheng authored Mar 13, 2025
  
  a5a892ff
12 Mar, 2025 1 commit
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
11 Mar, 2025 1 commit
- refactor: move image processors to separate files (#4229) · ff2ce0b8
  Mick authored Mar 12, 2025
  
  ff2ce0b8
25 Feb, 2025 1 commit
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde
16 Feb, 2025 1 commit
- Model: Support Qwen 2.5 vl (#3258) · bcc213df
  Mick authored Feb 16, 2025
  
  bcc213df
28 Jan, 2025 1 commit
- [Fix] Address remaining issues of supporting MiniCPMV (#2977) · 9f635ea5
  Mick authored Jan 28, 2025
  
  9f635ea5
19 Jan, 2025 1 commit
- Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956) · 4d4cdb3f
  Chang Su authored Jan 18, 2025
  
  4d4cdb3f
18 Jan, 2025 1 commit

[Feature] Support minicpmv v2.6 (#2785) · 3d93f84a

Mick authored Jan 19, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>

3d93f84a

28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
22 Nov, 2024 1 commit
- Fix #2037 - Context length check does not take into out pad tokens for visual models (#2106) · 8048c28c
  Jake Poznanski authored Nov 21, 2024
  
  8048c28c
03 Nov, 2024 1 commit
- Simplify tokenizer manager (#1904) · c17c5781
  Lianmin Zheng authored Nov 03, 2024
  
  c17c5781
02 Nov, 2024 1 commit
- Improve docs and fix the broken links (#1875) · d1b31b06
  Lianmin Zheng authored Nov 01, 2024
  
  d1b31b06
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
21 Oct, 2024 1 commit
- Llama3.2 vision model support (#1551) · 94cde109
  Liangsheng Yin authored Oct 21, 2024
  
  94cde109
20 Oct, 2024 4 commits
- [Bugfix] qwen2vl forward_extend (#1727) · 554fbf93
  yizhang2077 authored Oct 20, 2024
  
  554fbf93
- Split the overlapped version of TpModelWorkerClient into a separate file (#1726) · b48edff6
  Lianmin Zheng authored Oct 20, 2024
  
  b48edff6
- Temporarily skip this test_mixed_batch for QWen2VL (#1725) · 593b19f2
  Lianmin Zheng authored Oct 20, 2024
  
  593b19f2
- Support qwen2 vl model (#1721) · cbbc82b7
  Yineng Zhang authored Oct 19, 2024
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ispobock <ISPObaoke@163.com>
```
  cbbc82b7
17 Oct, 2024 1 commit
- Fix mixed batch for multi modal models (#1702) · d17d19e5
  Lianmin Zheng authored Oct 17, 2024
  
  d17d19e5
09 Sep, 2024 1 commit
- [Feat] Add modalities for vision server when handling pixel values for llava (#1346) · 662ecd93
  Kaichen Zhang - NTU authored Sep 09, 2024
  
  662ecd93
30 Aug, 2024 1 commit
- Allow more flexible assistant and system response (#1256) · 51c554d8
  Christopher Chou authored Aug 30, 2024
  
  51c554d8
28 Aug, 2024 1 commit
- [Fix] Fix llava on multi images (#1247) · bf53bf51
  Lianmin Zheng authored Aug 28, 2024
  
  bf53bf51
26 Aug, 2024 2 commits
- [Fix] Multi-images loading error (#1218) · 3579162a
  Kaichen Zhang - NTU authored Aug 26, 2024
  
  3579162a
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
25 Aug, 2024 2 commits
- Update CI workflows (#1210) · 15f1a49d
  Lianmin Zheng authored Aug 25, 2024
  
  15f1a49d
- [Fix] Fixing the multi-images error for llava-onevision (#1205) · 66e7dcaf
  Kaichen Zhang - NTU authored Aug 26, 2024
  
  66e7dcaf
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
23 Aug, 2024 1 commit

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2... · a5b14ad0

Kaichen Zhang - NTU authored Aug 24, 2024


[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)
Co-authored-by: Bo Li <drluodian@gmail.com>

a5b14ad0

13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 1 commit
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80