Commits · 7c0541b3859a4e3618f0379dc2aa882b445903bb · change / sglang · GitLab

10 Mar, 2025 6 commits
- Move activation.cu to sgl-kernel/elementwise (#4250) · 7c0541b3
  Lianmin Zheng authored Mar 09, 2025
  
  7c0541b3
- Clean up fp8 support (#4230) · e8a69e4d
  Lianmin Zheng authored Mar 09, 2025
  
  e8a69e4d
- Auto balance CI tests (#4238) · fbd56002
  Lianmin Zheng authored Mar 09, 2025
  
  fbd56002
- Minor style fix for sgl-kernel (#4243) · 730d084f
  Lianmin Zheng authored Mar 09, 2025
  
  730d084f
- Revert "Check eagle server args" (#4242) · 4a05bdfa
  Lianmin Zheng authored Mar 09, 2025
  
  4a05bdfa
- Move rope and bmm into sgl-kernel (#4241) · eb06dbcb
  Lianmin Zheng authored Mar 09, 2025
  
  eb06dbcb
09 Mar, 2025 15 commits
- Fix test of flashinfer mla with nextn (#4237) · 9dfafa74
  Baizhou Zhang authored Mar 09, 2025
  
  9dfafa74
- Update bench speculative script (#4235) · f1d09a65
  Ke Bao authored Mar 10, 2025
  
  f1d09a65
- update sgl-kernel 3rdparty (#4228) · df84ab2a
  Yineng Zhang authored Mar 09, 2025
  
  df84ab2a
- Check eagle server args (#4217) · 34c88987
  Ying Sheng authored Mar 09, 2025
  
  34c88987
- Apply sgl w8a8 fp8 kernel (#3148) · 0dd6cda2
  HandH1998 authored Mar 09, 2025
  
  0dd6cda2
- Support nextn for flashinfer mla attention backend (#4218) · 9fb48f95
  Baizhou Zhang authored Mar 09, 2025
  
  9fb48f95
- use sgl-kernel 0.0.4 (#4224) · 89ccb533
  Yineng Zhang authored Mar 08, 2025
  
  89ccb533
- [docs] Unhide production metrics page (#4193) · dceb256f
  Stefan He authored Mar 08, 2025
  
  dceb256f
- [docker] Distributed Serving with k8s Statefulset ( good example for DeepSeek-R1) (#3631) · 0e90ae62
  Peter Pan authored Mar 09, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Co-authored-by: Kebe <kebe.liu@daocloud.io>
```
  0e90ae62
- Lazily import lora backends (#4225) · 1361ab9e
  Lianmin Zheng authored Mar 08, 2025
  
  1361ab9e
- chore: bump v0.0.4 for sgl-kernel (#4223) · 5c7dd14b
  Yineng Zhang authored Mar 08, 2025
  
  5c7dd14b
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3
- use latest sgl-kernel for mla test (#4222) · ee132a45
  Yineng Zhang authored Mar 08, 2025
  
  ee132a45
- revert pr 3628 to pass test_mla ci (#4219) · 79a321af
  Xiaoyu Zhang authored Mar 09, 2025
  
  79a321af
- docs(reasoning content): 📝 deepseek-r1 parser support qwq (#4124) · 6eec3cdc
  Xihuai Wang authored Mar 09, 2025
  
  6eec3cdc
08 Mar, 2025 12 commits
- Split test_mla.py into two files (#4216) · 48473684
  Lianmin Zheng authored Mar 08, 2025
  
  48473684
- refine quant kernel code style (#4211) · b3251e9f
  Xiaoyu Zhang authored Mar 08, 2025
  
  b3251e9f
- Test no vllm custom allreduce (#4210) · 2cadd51d
  Lianmin Zheng authored Mar 08, 2025
  
  2cadd51d
- Refactor Dockerfile: unify CUDA logic and reduce image size by ~2.6 GB (#3749) · 4a893d14
  Kebe authored Mar 08, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  4a893d14
- Use clang format 18 in pr-test-sgl-kernel.yml (#4203) · 8d323e95
  Lianmin Zheng authored Mar 08, 2025
  
  8d323e95
- Fix bench_serving flush cache not recognizing OPENAI_API_KEY (#4181) · 0fe7c13b
  Mingshan authored Mar 08, 2025
```
Signed-off-by: Mingshan <git@brighill.com>
```
  0fe7c13b
- lazy import attn backends (#4200) · 08c4d764
  Lianmin Zheng authored Mar 08, 2025
  
  08c4d764
- Revert "Minor improvement to per_tensor_quant_fp8 (#4197)" (#4198) · 96d0e37f
  Yineng Zhang authored Mar 07, 2025
  
  96d0e37f
- Minor improvement to per_tensor_quant_fp8 (#4197) · 90bb2be2
  Rex authored Mar 07, 2025
  
  90bb2be2
- Remove the vllm dependency from the moe_align function (#4164) · b93ef5e5
  lukec authored Mar 08, 2025
```
Co-authored-by: Hongbosherlock <hongbosherlock@gmail.com>
```
  b93ef5e5
- [EAGLE] many fixes for eagle (#4195) · d4017a6b
  Lianmin Zheng authored Mar 07, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  d4017a6b
- New clang format for sgl kernel (#4194) · d052f4c8
  Lianmin Zheng authored Mar 07, 2025
  
  d052f4c8
07 Mar, 2025 7 commits
- Update amd ci docker image to v0.4.3.post4-rocm630. (#4189) · e1aaa79a
  saienduri authored Mar 07, 2025
  
  e1aaa79a
- Fix eagle hang issue for max_new_tokens=1 (#4185) · 20c81199
  Ke Bao authored Mar 08, 2025
  
  20c81199
- use same version for ci and pyproject (#4187) · 70866b6f
  Yineng Zhang authored Mar 07, 2025
  
  70866b6f
- Revert "ROCm: Flex Attention Enablement with custom backends (#4178)" (#4186) · eb61f5c9
  Yineng Zhang authored Mar 07, 2025
  
  eb61f5c9
- ROCm: Flex Attention Enablement with custom backends (#4178) · 0beea450
  HAI authored Mar 07, 2025
```
Co-authored-by: linsun12 <linsun12@amd.com>
```
  0beea450
- [Docs] Improve bullets appearance and grammar (#4174) · c827c671
  Michael Yao authored Mar 07, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c827c671
- fix int8 doc link (#4179) · b55a621f
  Yineng Zhang authored Mar 07, 2025
  
  b55a621f