Commits · 76f6c0ebf9853b9c07b63a3f0c243ac7b6d14511 · change / sglang

12 Mar, 2025 1 commit
- upgrade sgl-kernel 0.0.4.post3 (#4334) · ed91561f
  Yineng Zhang authored Mar 12, 2025
  
  ed91561f
11 Mar, 2025 3 commits
- upgrade flashinfer 0.2.3 (#4317) · 1cf63485
  Yineng Zhang authored Mar 11, 2025
```
Co-authored-by: qingquansong <qsong@linkedin.com>
```
  1cf63485
- [AMD] Fix rocm sgl-kernel missing modules error (#4311) · 690e1f23
  yigex authored Mar 12, 2025
```
Co-authored-by: yiakwy-xpu-ml-framework-team <leiwang2@amd.com>
```
  690e1f23
- update sgl-kernel 0.0.4.post2 (#4291) · 4d27eb9a
  Yineng Zhang authored Mar 11, 2025
  
  4d27eb9a
10 Mar, 2025 2 commits
- upgrade xgrammar 0.1.15 (#4275) · e187a3d5
  Yineng Zhang authored Mar 10, 2025
  
  e187a3d5
- Test no vllm custom allreduce (#4256) · 5a6400ee
  Lianmin Zheng authored Mar 10, 2025
  
  5a6400ee
09 Mar, 2025 1 commit
- use sgl-kernel 0.0.4 (#4224) · 89ccb533
  Yineng Zhang authored Mar 08, 2025
  
  89ccb533
08 Mar, 2025 1 commit

[EAGLE] many fixes for eagle (#4195) · d4017a6b

Lianmin Zheng authored Mar 07, 2025


Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>

d4017a6b

06 Mar, 2025 3 commits
- Release v0.4.3.post4 (#4140) · 9c58e68b
  Lianmin Zheng authored Mar 06, 2025
  
  9c58e68b
- Fix constrained generation errors by adding datasets dependency (#4142) · d03b3467
  Oliver Stanley authored Mar 06, 2025
  
  d03b3467
- chore: bump v0.4.3.post3 (#4114) · fc671f66
  Yineng Zhang authored Mar 05, 2025
  
  fc671f66
05 Mar, 2025 1 commit
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
04 Mar, 2025 1 commit
- ROCm: update aiter and its usage to fused moe (bloat16, fp8, fp8 block-quant) (#4053) · 51d25405
  HAI authored Mar 04, 2025
  
  51d25405
03 Mar, 2025 2 commits

Misc clean up; Remove the support of jump forward (#4032) · 935cda94
Lianmin Zheng authored Mar 03, 2025

935cda94

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

01 Mar, 2025 1 commit
- update flashinfer-python version · f3b99f73
  Yineng Zhang authored Feb 28, 2025
  
  f3b99f73
28 Feb, 2025 1 commit
- set a strict sgl-kernel version (#3950) · 90bc26a8
  Chayenne authored Feb 27, 2025
  
  90bc26a8
27 Feb, 2025 2 commits
- upgrade flashinfer v0.2.2.post1 (#3934) · 564bdf29
  Yineng Zhang authored Feb 27, 2025
  
  564bdf29
- Improve: Support xgrammar 0.1.14 (#3593) · d2815879
  Enrique Shockwave authored Feb 27, 2025
  
  d2815879
26 Feb, 2025 1 commit
- [Feature] Support llguidance for constrained decoding (#3298) · 7551498a
  JC1DA authored Feb 26, 2025
  
  7551498a
24 Feb, 2025 1 commit
- Fix dependency (#3813) · 27a46317
  Lianmin Zheng authored Feb 24, 2025
  
  27a46317
17 Feb, 2025 4 commits
- use transformers 4.48.3 (#3650) · 058d199d
  Yineng Zhang authored Feb 18, 2025
  
  058d199d
- chore: bump v0.4.3.post2 (#3645) · a5375adc
  Yineng Zhang authored Feb 18, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  a5375adc
- chore: update flashinfer v0.2.1.post2 (#3644) · 75d171a9
  Yineng Zhang authored Feb 18, 2025
  
  75d171a9
- chore: bump v0.4.3.post1 (#3638) · e782eb7e
  Yineng Zhang authored Feb 17, 2025
  
  e782eb7e
15 Feb, 2025 1 commit
- fix apply_token_bitmask_inplace_cuda (#3594) · bbc47c34
  Yineng Zhang authored Feb 15, 2025
  
  bbc47c34
14 Feb, 2025 2 commits
- chore: bump v0.4.3 (#3556) · e0b9a423
  Yineng Zhang authored Feb 14, 2025
  
  e0b9a423
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
12 Feb, 2025 2 commits
- integrate blockwise fp8 kernel (#3529) · 98eecbda
  yizhang2077 authored Feb 13, 2025
  
  98eecbda
- use sgl_per_token_group_quant_fp8 kernel (#3493) · 45e3a7bc
  Xiaoyu Zhang authored Feb 12, 2025
  
  45e3a7bc
10 Feb, 2025 1 commit
- chore: bump v0.4.2.post4 (#3459) · cddb1cdf
  Yineng Zhang authored Feb 10, 2025
  
  cddb1cdf
09 Feb, 2025 1 commit
- compatible with new outlines (#3435) · 85986bb9
  Yineng Zhang authored Feb 10, 2025
  
  85986bb9
07 Feb, 2025 2 commits
- chore: bump v0.4.2.post3 (#3369) · c1f5f99f
  Yineng Zhang authored Feb 08, 2025
  
  c1f5f99f
- update sgl-kernel version (#3374) · f2870376
  Yineng Zhang authored Feb 07, 2025
  
  f2870376
05 Feb, 2025 1 commit
- chore: bump v0.4.2.post2 (#3313) · 7aad8d18
  Yineng Zhang authored Feb 05, 2025
  
  7aad8d18
04 Feb, 2025 2 commits
- ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) · 2c1a695f
  HAI authored Feb 04, 2025
  
  2c1a695f
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
02 Feb, 2025 1 commit
- ROCm: bump 6.3.0 (#3259) · 566d61d9
  HAI authored Feb 02, 2025
  
  566d61d9
31 Jan, 2025 2 commits
- update sgl-kernel version for sglang (#3238) · 34e405e0
  Yineng Zhang authored Feb 01, 2025
  
  34e405e0
- chore: bump v0.4.2.post1 (#3233) · cf0f7eaf
  Yineng Zhang authored Jan 31, 2025
  
  cf0f7eaf