Commits · d8a136a11332117229aca73abbc5edcf2b9ebd76 · change / sglang

29 Mar, 2025 1 commit
- upgrade sgl-kernel 0.0.5.post4 (#4873) · d8a136a1
  Yineng Zhang authored Mar 28, 2025
  
  d8a136a1
28 Mar, 2025 3 commits
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
- Fix torch.cuda.MemPool() internal assertion failure (#4687) · d3f71f5e
  fzyzcjy authored Mar 28, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  d3f71f5e
- [Fix] Add compressed_tensors as deps (#4819) · bb0fd749
  Junrong Lin authored Mar 28, 2025
  
  bb0fd749
27 Mar, 2025 3 commits
- add partial_json_parser and einops (#4827) · bbab97a6
  Yineng Zhang authored Mar 27, 2025
  
  bbab97a6
- update xgrammar 0.1.17 (#4804) · 6f5cc5eb
  Yineng Zhang authored Mar 27, 2025
  
  6f5cc5eb
- bump v0.4.4.post2 (#4669) · 1099f6c9
  Yineng Zhang authored Mar 26, 2025
  
  1099f6c9
26 Mar, 2025 2 commits
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
- Warn users when release_memory_occupation is called without memory saver enabled (#4566) · 26f07294
  fzyzcjy authored Mar 26, 2025
  
  26f07294
25 Mar, 2025 1 commit
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
24 Mar, 2025 2 commits
- update pyproject (#4731) · c11cfda0
  Yineng Zhang authored Mar 24, 2025
  
  c11cfda0
- Support dynamic version name in sglang's pyproject.toml (#4720) · 64edeb79
  Yuhong Guo authored Mar 24, 2025
  
  64edeb79
22 Mar, 2025 1 commit
- [Bug Fix] Add partial rotary factor support for Phi-4 and upgrade to transformers v4.50.0 (#3984) · f8f9244a
  Adarsh Shirawalmath authored Mar 23, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  f8f9244a
17 Mar, 2025 2 commits
- upgrade sgl-kernel 0.0.5.post3 (#4522) · f81a27f6
  Yineng Zhang authored Mar 17, 2025
  
  f81a27f6
- Constraint Decoding: Set xgrammar as the default grammar backend (#4386) · 452db508
  mlmz authored Mar 17, 2025
  
  452db508
16 Mar, 2025 1 commit
- [Eagle] Remove the greedy branch and some redundant code (#4363) · 1b859295
  Ying Sheng authored Mar 16, 2025
```
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  1b859295
14 Mar, 2025 2 commits
- use topk_softmax with sgl-kernel (#4439) · ad1ae7f7
  Yineng Zhang authored Mar 14, 2025
  
  ad1ae7f7
- bump v0.4.4.post1 (#4402) · ba80c102
  Yineng Zhang authored Mar 13, 2025
  
  ba80c102
13 Mar, 2025 5 commits
- chore: bump v0.4.4 (#4041) · 6aaeb848
  Yineng Zhang authored Mar 13, 2025
  
  6aaeb848
- upgrade sgl-kernel 0.0.5 (#4381) · 3623b6a7
  Yineng Zhang authored Mar 13, 2025
  
  3623b6a7
- Revert "[XPU][CPU] Enable the native path of DeepSeek" (#4367) · 45de8971
  Lianmin Zheng authored Mar 12, 2025
  
  45de8971
- [XPU][CPU] Enable the native path of DeepSeek (#4086) · 71046fcd
  Meng, Hengyu authored Mar 13, 2025
```
Co-authored-by: Zhang, Liangang <liangang.zhang@intel.com>
```
  71046fcd
- Move `aiohttp` into public dependencies (#3980) · ccdd10c8
  YR Chen authored Mar 13, 2025
  
  ccdd10c8
12 Mar, 2025 1 commit
- upgrade sgl-kernel 0.0.4.post3 (#4334) · ed91561f
  Yineng Zhang authored Mar 12, 2025
  
  ed91561f
11 Mar, 2025 3 commits
- upgrade flashinfer 0.2.3 (#4317) · 1cf63485
  Yineng Zhang authored Mar 11, 2025
```
Co-authored-by: qingquansong <qsong@linkedin.com>
```
  1cf63485
- [AMD] Fix rocm sgl-kernel missing modules error (#4311) · 690e1f23
  yigex authored Mar 12, 2025
```
Co-authored-by: yiakwy-xpu-ml-framework-team <leiwang2@amd.com>
```
  690e1f23
- update sgl-kernel 0.0.4.post2 (#4291) · 4d27eb9a
  Yineng Zhang authored Mar 11, 2025
  
  4d27eb9a
10 Mar, 2025 2 commits
- upgrade xgrammar 0.1.15 (#4275) · e187a3d5
  Yineng Zhang authored Mar 10, 2025
  
  e187a3d5
- Test no vllm custom allreduce (#4256) · 5a6400ee
  Lianmin Zheng authored Mar 10, 2025
  
  5a6400ee
09 Mar, 2025 1 commit
- use sgl-kernel 0.0.4 (#4224) · 89ccb533
  Yineng Zhang authored Mar 08, 2025
  
  89ccb533
08 Mar, 2025 1 commit

[EAGLE] many fixes for eagle (#4195) · d4017a6b

Lianmin Zheng authored Mar 07, 2025


Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>

d4017a6b

06 Mar, 2025 3 commits
- Release v0.4.3.post4 (#4140) · 9c58e68b
  Lianmin Zheng authored Mar 06, 2025
  
  9c58e68b
- Fix constrained generation errors by adding datasets dependency (#4142) · d03b3467
  Oliver Stanley authored Mar 06, 2025
  
  d03b3467
- chore: bump v0.4.3.post3 (#4114) · fc671f66
  Yineng Zhang authored Mar 05, 2025
  
  fc671f66
05 Mar, 2025 1 commit
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
04 Mar, 2025 1 commit
- ROCm: update aiter and its usage to fused moe (bloat16, fp8, fp8 block-quant) (#4053) · 51d25405
  HAI authored Mar 04, 2025
  
  51d25405
03 Mar, 2025 2 commits

Misc clean up; Remove the support of jump forward (#4032) · 935cda94
Lianmin Zheng authored Mar 03, 2025

935cda94

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

01 Mar, 2025 1 commit
- update flashinfer-python version · f3b99f73
  Yineng Zhang authored Feb 28, 2025
  
  f3b99f73
28 Feb, 2025 1 commit
- set a strict sgl-kernel version (#3950) · 90bc26a8
  Chayenne authored Feb 27, 2025
  
  90bc26a8