Commits · 2c7dbb7cc2306d00f1ca4713d6f9d9901ad6da56 · change / sglang

29 Apr, 2025 3 commits
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
- [Feature] support auto chat template (#4949) · 2c3ea294
  woodx authored Apr 29, 2025
  
  2c3ea294
- [CI] tune the test order to warmup the server (#5860) · 26fc32d1
  Lianmin Zheng authored Apr 28, 2025
  
  26fc32d1
28 Apr, 2025 1 commit
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
27 Apr, 2025 13 commits
- [CI] Improve github summary & enable fa3 for more models (#5796) · daed453e
  Lianmin Zheng authored Apr 27, 2025
  
  daed453e
- Add 8-GPU Test for Deepseek-V3 (#5691) · f9fb33ef
  Baizhou Zhang authored Apr 27, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  f9fb33ef
- [CI] Fix test case (#5790) · a38f6932
  Lianmin Zheng authored Apr 27, 2025
  
  a38f6932
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
- [CI] fix port conflicts (#5789) · 35ca04d2
  Lianmin Zheng authored Apr 27, 2025
  
  35ca04d2
- [CI] Tune threshold (#5787) · 3c4e0ee6
  Lianmin Zheng authored Apr 27, 2025
  
  3c4e0ee6
- Simplify FA3 tests (#5779) · 4d23ba08
  Lianmin Zheng authored Apr 27, 2025
  
  4d23ba08
- Split local attention test from fa3 test (#5774) · a45a4b23
  Baizhou Zhang authored Apr 27, 2025
  
  a45a4b23
- Fix eagle test case (#5776) · 981a2619
  Lianmin Zheng authored Apr 27, 2025
  
  981a2619
- update llguidance to 0.7.11; adds StructTag (#4870) · bdbe5f81
  Michał Moskal authored Apr 26, 2025
  
  bdbe5f81
- Add Llama 4 to FA3 test (#5509) · 408ba022
  Stefan He authored Apr 26, 2025
  
  408ba022
- [feature] support for roberta embedding models (#5730) · d8fbc7c0
  DavidBao authored Apr 27, 2025
  
  d8fbc7c0
- CI: rewrite test_vision_chunked_prefill to speedup (#5682) · 02723e1b
  Mick authored Apr 27, 2025
  
  02723e1b
26 Apr, 2025 2 commits

[Fix]: support deepseek-vl2-tiny model (#5552) · 04d0123f
ZXN authored Apr 26, 2025
```
Co-authored-by: bppps <zouyu.zzx@alibaba-inc.com>
```
04d0123f

fix: fix one more bug from merging mm_inputs (#5718) · feda9b11

Mick authored Apr 26, 2025


Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>

feda9b11

25 Apr, 2025 2 commits
- Disable flaky eagle tests (#5753) · 21514ff5
  Lianmin Zheng authored Apr 25, 2025
  
  21514ff5
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
23 Apr, 2025 2 commits
- tune the threshold of gemma-2-27b-it in test_nightly_gsm8k_eval.py (#5677) · de071366
  Lianmin Zheng authored Apr 23, 2025
  
  de071366
- fix gemma3 unit test (#5670) · 8777a1d2
  Yineng Zhang authored Apr 23, 2025
  
  8777a1d2
21 Apr, 2025 5 commits
- upstream hicache fixes (#5570) · 70645f4d
  Zhiqiang Xie authored Apr 20, 2025
  
  70645f4d
- Add Speculative Decoding Eagle3 topk > 1 (#5318) · 188f0955
  Qingquan Song authored Apr 20, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Yubo Wang <yubowang2019@gmail.com>
```
  188f0955
- Feat: Implement JSON Mode (response_format.type="json_object") (#4733) · 9f3bd2ad
  kyle-pena-kuzco authored Apr 20, 2025
```
Co-authored-by: Kyle Pena <kylepena@kyles-macbook-pro.turkey-marlin.ts.net>
```
  9f3bd2ad
- [Feature] Prefill assistant response - add continue_final_message parameter (#4226) · 8b39274e
  Adarsh Shirawalmath authored Apr 21, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  8b39274e
- Add test config yamls for Deepseek v3 (#5433) · 5156d5a4
  Baizhou Zhang authored Apr 20, 2025
  
  5156d5a4
19 Apr, 2025 1 commit
- restruct compressed_tensors_w8a8_fp8 (#5475) · bf86c5e9
  Xiaoyu Zhang authored Apr 19, 2025
  
  bf86c5e9
17 Apr, 2025 2 commits

Feat/support encoder model (like bert) (#4887) · 3bface15
woodx authored Apr 17, 2025

3bface15

[Model Support] unsloth/Phi-4-mini bnb model (#4982) · 8f783c19

eigen authored Apr 16, 2025


Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

8f783c19

16 Apr, 2025 4 commits
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
- Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) · a42736bb
  Baizhou Zhang authored Apr 15, 2025
  
  a42736bb
- Support BNB quantization for llama/mllama (#5038) · bc24205b
  ryang authored Apr 16, 2025
```
Co-authored-by: Yuhao Yang <yyh073@foxmail.com>
```
  bc24205b
- Fix ignore_eos parameter when loading a chat template (#5264) · 27a009bb
  Chang Su authored Apr 15, 2025
  
  27a009bb
15 Apr, 2025 2 commits
- [misc] fix ci flaky case (#5352) · f88f7e19
  JieXin Liang authored Apr 15, 2025
  
  f88f7e19
- fix: update test config (#5392) · ac5b78ba
  Yineng Zhang authored Apr 14, 2025
  
  ac5b78ba
14 Apr, 2025 2 commits
- Support for Qwen2.5-VL Model in bitsandbytes Format (#5003) · 072df753
  yhyang201 authored Apr 14, 2025
  
  072df753
- Fix DeepSeek DP Attention + torch compile (#5367) · defede50
  fzyzcjy authored Apr 14, 2025
```
Co-authored-by: ispobock <ispobaoke@163.com>
```
  defede50