Commits · 35ca04d2fa2ff78a74ec526bb916688a76b04120 · change / sglang

27 Apr, 2025 7 commits
- [CI] fix port conflicts (#5789) · 35ca04d2
  Lianmin Zheng authored Apr 27, 2025
  
  35ca04d2
- [CI] Tune threshold (#5787) · 3c4e0ee6
  Lianmin Zheng authored Apr 27, 2025
  
  3c4e0ee6
- Simplify FA3 tests (#5779) · 4d23ba08
  Lianmin Zheng authored Apr 27, 2025
  
  4d23ba08
- Split local attention test from fa3 test (#5774) · a45a4b23
  Baizhou Zhang authored Apr 27, 2025
  
  a45a4b23
- Fix eagle test case (#5776) · 981a2619
  Lianmin Zheng authored Apr 27, 2025
  
  981a2619
- Add Llama 4 to FA3 test (#5509) · 408ba022
  Stefan He authored Apr 26, 2025
  
  408ba022
- CI: rewrite test_vision_chunked_prefill to speedup (#5682) · 02723e1b
  Mick authored Apr 27, 2025
  
  02723e1b
25 Apr, 2025 1 commit
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
21 Apr, 2025 1 commit

Add Speculative Decoding Eagle3 topk > 1 (#5318) · 188f0955

Qingquan Song authored Apr 20, 2025


Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Yubo Wang <yubowang2019@gmail.com>

188f0955

19 Apr, 2025 1 commit
- restruct compressed_tensors_w8a8_fp8 (#5475) · bf86c5e9
  Xiaoyu Zhang authored Apr 19, 2025
  
  bf86c5e9
14 Apr, 2025 1 commit
- Support for Qwen2.5-VL Model in bitsandbytes Format (#5003) · 072df753
  yhyang201 authored Apr 14, 2025
  
  072df753
09 Apr, 2025 2 commits
- [ci] fix ci test fused_moe op (#5102) · 87eddedf
  Xiaoyu Zhang authored Apr 09, 2025
  
  87eddedf
- Support Llama4 fp8 inference (#5194) · 40652482
  HandH1998 authored Apr 09, 2025
```
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>
```
  40652482
08 Apr, 2025 1 commit
- Add unit test on page_size > 1 and mla and integration test for Flash Attention 3 (#4760) · 804d9f2e
  Yubo Wang authored Apr 07, 2025
  
  804d9f2e
30 Mar, 2025 3 commits
- Fix 2-gpu CI test and suppress some warnings (#4930) · 9adf178c
  Lianmin Zheng authored Mar 30, 2025
  
  9adf178c
- Fix retract for page size > 1 (#4914) · 4ede6770
  Lianmin Zheng authored Mar 30, 2025
  
  4ede6770
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
28 Mar, 2025 2 commits
- [Feature] add multi-rank support for Lora (#4492) · ef9a378a
  chaobo jia authored Mar 29, 2025
```
Co-authored-by: rudy152 <czh1137892874@gmail.com>
```
  ef9a378a
- Fix CI of test_patch_torch (#4844) · 0d3e3072
  fzyzcjy authored Mar 28, 2025
  
  0d3e3072
27 Mar, 2025 2 commits
- Patch PyTorch's bug that cross-process tensor transfer will lead to wrong device (#4565) · 92bb49a7
  fzyzcjy authored Mar 27, 2025
  
  92bb49a7
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
26 Mar, 2025 1 commit
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
25 Mar, 2025 2 commits
- add dsv3 int8 test (#4705) · 2d1b83e5
  HandH1998 authored Mar 25, 2025
  
  2d1b83e5
- Add endpoints to dump selected expert ids (#4435) · 199bb01d
  yuhsaun-t authored Mar 24, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  199bb01d
18 Mar, 2025 2 commits
- fix: second_per_grid_ts should be used to get mrope position (#3682) · d373a48c
  Mick authored Mar 18, 2025
  
  d373a48c
- Unit test for Hierarchical Caching (#4486) · a98290ae
  Zhiqiang Xie authored Mar 17, 2025
  
  a98290ae
17 Mar, 2025 1 commit
- Feature: support code completion (#3612) · 48efec7b
  woodx authored Mar 17, 2025
  
  48efec7b
15 Mar, 2025 1 commit
- Fix test_create_kvindices unit test (#4452) · 21d485f8
  lukec authored Mar 16, 2025
  
  21d485f8
13 Mar, 2025 2 commits
- Add a dummy grok test case (#4399) · f0afaf52
  Lianmin Zheng authored Mar 13, 2025
  
  f0afaf52
- Support page size > 1 (#4356) · c76040e3
  Lianmin Zheng authored Mar 12, 2025
  
  c76040e3
10 Mar, 2025 4 commits
- Amd test fp8 (#4261) · 2ac189ed
  HandH1998 authored Mar 11, 2025
  
  2ac189ed
- Fix quantization and nightly tests (#4258) · 00d25a7f
  Lianmin Zheng authored Mar 10, 2025
  
  00d25a7f
- Simplify tests & Fix trtllm custom allreduce registration (#4252) · aa957102
  Lianmin Zheng authored Mar 10, 2025
  
  aa957102
- Auto balance CI tests (#4238) · fbd56002
  Lianmin Zheng authored Mar 09, 2025
  
  fbd56002
08 Mar, 2025 1 commit
- Split test_mla.py into two files (#4216) · 48473684
  Lianmin Zheng authored Mar 08, 2025
  
  48473684
07 Mar, 2025 2 commits
- [Feature] DeepSeek V3/R1 INT8 Quantization (channel-wise) (#3888) · c7f25446
  HandH1998 authored Mar 07, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: b0urnee <2769086541@qq.com>
```
  c7f25446
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8
05 Mar, 2025 1 commit
- [QUANT] Add GPTQModel Dynamic Quantization + `lm_head` Quantization (#3790) · 56a724eb
  Qubitium-ModelCloud authored Mar 05, 2025
```
Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
Co-authored-by: ZX-ModelCloud <zx@modelcloud.ai>
```
  56a724eb
04 Mar, 2025 1 commit
- Reasoning parser (#4000) · 95575aa7
  Xihuai Wang authored Mar 04, 2025
```
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
```
  95575aa7