Commits · e983e43248202f96177ff4c4897fb8dc8dabe71f · change / sglang · GitLab

02 Apr, 2025 5 commits
- Add Eagle Speculative Decoding to FA3 Backend (#4951) · e983e432
  Qingquan Song authored Apr 02, 2025
```
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: zcnrex <zcnrex@gmail.com>
```
  e983e432
- sgl scaled_fp8_quant support output padding (#4861) · e9c6ce46
  Xiaoyu Zhang authored Apr 02, 2025
  
  e9c6ce46
- bug fix for hicache host eviction (#4989) · 3fadc647
  Zhiqiang Xie authored Apr 02, 2025
  
  3fadc647
- Large page size aligned hierarchical caching (#4581) · e119f042
  Zhiqiang Xie authored Apr 01, 2025
  
  e119f042
- [VLM RLHF] Take Image input for verl vlm rollout (#4915) · 9eb49e87
  XinyuanTong authored Apr 01, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: GeLee <leege233@gmail.com>
```
  9eb49e87
01 Apr, 2025 4 commits
- Prevent memory leak of retract_decode when page_size > 1 (#4977) · 12047f5e
  Zhiqiang Xie authored Apr 01, 2025
  
  12047f5e
- update bench_serving (#4958) · fda6bb78
  Yineng Zhang authored Apr 01, 2025
  
  fda6bb78
- [Feature] Support DeepEP Low Latency (#4767) · 23c764b1
  Jinyan Chen authored Apr 02, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  23c764b1
- Revert PR 4764 & 4813 related to R1 RoPE (#4959) · 87fafa01
  Yuhong Guo authored Apr 01, 2025
  
  87fafa01
31 Mar, 2025 10 commits
- use fa3 in sgl-kernel (#4954) · 1c63e797
  Yineng Zhang authored Mar 31, 2025
  
  1c63e797
- [Build] Fix cuda12.8 build error in nvfp4_scaled_mm_kernels.cu (#4953) · ee47a6c1
  Yuhong Guo authored Apr 01, 2025
  
  ee47a6c1
- bump sgl-kernel v0.0.6 (#4950) · 6384d317
  Yineng Zhang authored Mar 31, 2025
  
  6384d317
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
- [Fix] revert clean m.def for cudagraph (#4944) · c7457191
  yinfan98 authored Mar 31, 2025
  
  c7457191
- [feat] interface for platforms abstraction (#4928) · 51ac297a
  JieXin Liang authored Mar 31, 2025
  
  51ac297a
- Fix oom error for large page size (#4913) · a169b9f8
  Zhiqiang Xie authored Mar 30, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a169b9f8
- [Fix] Add torch compile for torch.clamp back (#4936) · 4a63bc32
  Baizhou Zhang authored Mar 30, 2025
  
  4a63bc32
- Fix DeepSeek bug causing 2.2% MMLU drop when TP!=DP (#4883) · a303325f
  fzyzcjy authored Mar 31, 2025
```
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  a303325f
- [Fix] Improve Lora tests and reduce CI runtime (#4925) · 42873eac
  Baizhou Zhang authored Mar 30, 2025
  
  42873eac
30 Mar, 2025 12 commits
- cleanup sgl-kernel (#4933) · 4814ecaf
  Yineng Zhang authored Mar 30, 2025
  
  4814ecaf
- [Fix] avoid stream sync and torch compile in prefill for fa3 backend (#4932) · e62d60fe
  Baizhou Zhang authored Mar 30, 2025
  
  e62d60fe
- Fix sglang frontend's incorrect dependency on torch (#4931) · 032f8faa
  SEPLOS authored Mar 31, 2025
  
  032f8faa
- [feat] add fa3 in sgl-kernel (#4902) · 37c66ec8
  yinfan98 authored Mar 31, 2025
```
Co-authored-by: Sleepcoo <Sleepcoo@gmail.com>
```
  37c66ec8
- Fix 2-gpu CI test and suppress some warnings (#4930) · 9adf178c
  Lianmin Zheng authored Mar 30, 2025
  
  9adf178c
- Fix the timeout for unit-test-2-gpu in pr-test.yml (#4927) · f842853a
  Lianmin Zheng authored Mar 30, 2025
  
  f842853a
- fix bmm fp8 (#4926) · 195a09f5
  Yineng Zhang authored Mar 30, 2025
  
  195a09f5
- [Feature] use pytest for sgl-kernel (#4896) · 9fccda31
  Adarsh Shirawalmath authored Mar 30, 2025
  
  9fccda31
- Fix retract for page size > 1 (#4914) · 4ede6770
  Lianmin Zheng authored Mar 30, 2025
  
  4ede6770
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
- fix allreduce test (#4909) · 5ec5eaf7
  Yi Zhang authored Mar 30, 2025
  
  5ec5eaf7
- [Misc] Clean m.def and add Development Tips (#4890) · 0d7fe866
  yinfan98 authored Mar 30, 2025
  
  0d7fe866
29 Mar, 2025 9 commits
- remove setup for sgl-kernel (#4899) · 54b9a2de
  Yineng Zhang authored Mar 29, 2025
  
  54b9a2de
- quick fix: add default for new kernel (#4898) · 8e7b3154
  yinfan98 authored Mar 30, 2025
  
  8e7b3154
- Add deepseek style fused moe group gate selection kernel (#4530) · 45dcfc2e
  Qingquan Song authored Mar 29, 2025
  
  45dcfc2e
- Delete test_deep_gemm.py (#4891) · ddf8981d
  yinfan98 authored Mar 30, 2025
  
  ddf8981d
- Update CODEOWNERS (#4889) · 400ad660
  Yineng Zhang authored Mar 29, 2025
  
  400ad660
- [Docs] Update DeepGEMM at README.md (#4886) · 05625b97
  yinfan98 authored Mar 30, 2025
  
  05625b97
- Tiny fix doc error (#4795) · 736502d4
  fzyzcjy authored Mar 29, 2025
  
  736502d4
- Improve stack trace of retry errors (#4845) · 8690c40b
  fzyzcjy authored Mar 29, 2025
  
  8690c40b
- Fix BadRequestError wrong arguments and remove openai dependency (#4882) · b1cfb4e9
  fzyzcjy authored Mar 29, 2025
  
  b1cfb4e9