Commits · 4725e3f65218b441789b685c84dda810fcb62a79 · change / sglang

"vscode:/vscode.git/clone" did not exist on "e3055164f7c5ee8be5e8b27c38fe1ec8450c06b8"

04 Mar, 2025 1 commit
- ROCm: update aiter and its usage to fused moe (bloat16, fp8, fp8 block-quant) (#4053) · 51d25405
  HAI authored Mar 04, 2025
  
  51d25405
03 Mar, 2025 2 commits

Misc clean up; Remove the support of jump forward (#4032) · 935cda94
Lianmin Zheng authored Mar 03, 2025

935cda94

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

01 Mar, 2025 1 commit
- update flashinfer-python version · f3b99f73
  Yineng Zhang authored Feb 28, 2025
  
  f3b99f73
28 Feb, 2025 1 commit
- set a strict sgl-kernel version (#3950) · 90bc26a8
  Chayenne authored Feb 27, 2025
  
  90bc26a8
27 Feb, 2025 2 commits
- upgrade flashinfer v0.2.2.post1 (#3934) · 564bdf29
  Yineng Zhang authored Feb 27, 2025
  
  564bdf29
- Improve: Support xgrammar 0.1.14 (#3593) · d2815879
  Enrique Shockwave authored Feb 27, 2025
  
  d2815879
26 Feb, 2025 1 commit
- [Feature] Support llguidance for constrained decoding (#3298) · 7551498a
  JC1DA authored Feb 26, 2025
  
  7551498a
24 Feb, 2025 1 commit
- Fix dependency (#3813) · 27a46317
  Lianmin Zheng authored Feb 24, 2025
  
  27a46317
17 Feb, 2025 4 commits
- use transformers 4.48.3 (#3650) · 058d199d
  Yineng Zhang authored Feb 18, 2025
  
  058d199d
- chore: bump v0.4.3.post2 (#3645) · a5375adc
  Yineng Zhang authored Feb 18, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  a5375adc
- chore: update flashinfer v0.2.1.post2 (#3644) · 75d171a9
  Yineng Zhang authored Feb 18, 2025
  
  75d171a9
- chore: bump v0.4.3.post1 (#3638) · e782eb7e
  Yineng Zhang authored Feb 17, 2025
  
  e782eb7e
15 Feb, 2025 1 commit
- fix apply_token_bitmask_inplace_cuda (#3594) · bbc47c34
  Yineng Zhang authored Feb 15, 2025
  
  bbc47c34
14 Feb, 2025 2 commits
- chore: bump v0.4.3 (#3556) · e0b9a423
  Yineng Zhang authored Feb 14, 2025
  
  e0b9a423
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
12 Feb, 2025 2 commits
- integrate blockwise fp8 kernel (#3529) · 98eecbda
  yizhang2077 authored Feb 13, 2025
  
  98eecbda
- use sgl_per_token_group_quant_fp8 kernel (#3493) · 45e3a7bc
  Xiaoyu Zhang authored Feb 12, 2025
  
  45e3a7bc
10 Feb, 2025 1 commit
- chore: bump v0.4.2.post4 (#3459) · cddb1cdf
  Yineng Zhang authored Feb 10, 2025
  
  cddb1cdf
09 Feb, 2025 1 commit
- compatible with new outlines (#3435) · 85986bb9
  Yineng Zhang authored Feb 10, 2025
  
  85986bb9
07 Feb, 2025 2 commits
- chore: bump v0.4.2.post3 (#3369) · c1f5f99f
  Yineng Zhang authored Feb 08, 2025
  
  c1f5f99f
- update sgl-kernel version (#3374) · f2870376
  Yineng Zhang authored Feb 07, 2025
  
  f2870376
05 Feb, 2025 1 commit
- chore: bump v0.4.2.post2 (#3313) · 7aad8d18
  Yineng Zhang authored Feb 05, 2025
  
  7aad8d18
04 Feb, 2025 2 commits
- ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) · 2c1a695f
  HAI authored Feb 04, 2025
  
  2c1a695f
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
02 Feb, 2025 1 commit
- ROCm: bump 6.3.0 (#3259) · 566d61d9
  HAI authored Feb 02, 2025
  
  566d61d9
31 Jan, 2025 2 commits
- update sgl-kernel version for sglang (#3238) · 34e405e0
  Yineng Zhang authored Feb 01, 2025
  
  34e405e0
- chore: bump v0.4.2.post1 (#3233) · cf0f7eaf
  Yineng Zhang authored Jan 31, 2025
  
  cf0f7eaf
27 Jan, 2025 2 commits
- chore: bump v0.4.2 (#3180) · 4ab43cfb
  Yineng Zhang authored Jan 27, 2025
  
  4ab43cfb
- feat: use sgl-kernel 0.0.3 in sglang (#3179) · 2f79f588
  Yineng Zhang authored Jan 27, 2025
  
  2f79f588
26 Jan, 2025 1 commit
- udpate sgl-kernel version for srt (#3150) · 7e097613
  Yineng Zhang authored Jan 26, 2025
  
  7e097613
20 Jan, 2025 1 commit
- chore: bump v0.4.1.post7 (#3009) · e94fb7cb
  Yineng Zhang authored Jan 20, 2025
  
  e94fb7cb
19 Jan, 2025 2 commits
- support regex in xgrammar backend (#2983) · 3bcf5ece
  Enrique Shockwave authored Jan 19, 2025
  
  3bcf5ece
- fix custom op version compatibility (#2988) · 2c05f81f
  Yineng Zhang authored Jan 20, 2025
  
  2c05f81f
17 Jan, 2025 1 commit
- Enable CPU device on SGLang (#2806) · 63051738
  Chunyuan WU authored Jan 17, 2025
  
  63051738
15 Jan, 2025 2 commits
- adapt custom allreduce for tensorrt llm (#2511) · 767c9dec
  yizhang2077 authored Jan 16, 2025
  
  767c9dec
- chore: bump v0.4.1.post6 (#2899) · b3e99dfb
  Yineng Zhang authored Jan 15, 2025
  
  b3e99dfb
13 Jan, 2025 3 commits
- CUDA-graph-compatible releasing and resuming KV cache and model weight memory (#2630) · 923f5183
  fzyzcjy authored Jan 14, 2025
  
  923f5183
- Sampling penalties memory interface (#2870) · d08c77c4
  Xiaoyu Zhang authored Jan 13, 2025
  
  d08c77c4
- Revert "Integration of TurboMind AWQ" (#2866) · 6249e4a1
  Lianmin Zheng authored Jan 13, 2025
  
  6249e4a1