Commits · 621dfb88864c645ae4e6d41807c5ce6f78c33294 · change / sglang

30 Oct, 2025 1 commit
- Import flash_mla from sgl-kernel (#12135) · 621dfb88
  Baizhou Zhang authored Oct 29, 2025
  
  621dfb88
04 Oct, 2025 1 commit
- [fix]enable flashmla when using draft model P/D attention select (#11012) · 666da3d5
  Hank Han authored Oct 04, 2025
  
  666da3d5
05 Sep, 2025 1 commit
- [Fix] Add speculative_draft_model_revision to server_args (#5255) · 13705dae
  DevashishLal-CB authored Sep 05, 2025
```
Signed-off-by: Devashish Lal <devashish@rivosinc.com>
```
  13705dae
04 Jul, 2025 1 commit
- Add V2-lite model test (#7390) · 4de03953
  YanbingJiang authored Jul 04, 2025
```
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  4de03953
15 May, 2025 1 commit

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) · 2e4babdb

quinnrong94 authored May 15, 2025


Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>

2e4babdb

11 May, 2025 1 commit
- Fix request abortion (#6184) · de167cf5
  Lianmin Zheng authored May 10, 2025
  
  de167cf5
06 May, 2025 1 commit
- [Fix] Fix and rename flashmla CI test (#6045) · bdd17998
  Baizhou Zhang authored May 06, 2025
  
  bdd17998
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
04 Mar, 2025 1 commit
- Update nextn ci test (#4071) · 03b0364f
  Ke Bao authored Mar 05, 2025
  
  03b0364f
02 Mar, 2025 1 commit
- Add accuracy test for TP torch compile (#3994) · d3fe9bae
  Ke Bao authored Mar 03, 2025
  
  d3fe9bae
24 Feb, 2025 1 commit
- Fix dependency (#3813) · 27a46317
  Lianmin Zheng authored Feb 24, 2025
  
  27a46317
20 Feb, 2025 1 commit
- [Fix] Fix bugs and refactor codes in lora for better scalability. (#3652) · e79f7420
  aoshen524 authored Feb 20, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  e79f7420
21 Jan, 2025 1 commit
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
20 Jan, 2025 1 commit
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
17 Jan, 2025 1 commit
- Add ut for qwen model (#2947) · d47c5101
  Ke Bao authored Jan 18, 2025
  
  d47c5101
13 Jan, 2025 1 commit
- Use only one GPU for MLA CI tests (#2858) · 67008f4b
  Lianmin Zheng authored Jan 13, 2025
  
  67008f4b
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
18 Nov, 2024 1 commit
- Simplify flashinfer indices update for prefill (#2074) · 4af3f889
  Lianmin Zheng authored Nov 18, 2024
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: kavioyu <kavioyu@gmail.com>
```
  4af3f889
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
21 Sep, 2024 2 commits
- Add MLA gsm8k eval (#1484) · b8ccaf4d
  Ke Bao authored Sep 21, 2024
  
  b8ccaf4d
- Fix triton head num (#1482) · a68cb201
  Ke Bao authored Sep 21, 2024
  
  a68cb201
14 Sep, 2024 1 commit
- Add pytorch sampling backend ut (#1425) · 33b54e7c
  Ke Bao authored Sep 14, 2024
  
  33b54e7c
11 Sep, 2024 1 commit
- Deprecate --disable-flashinfer and introduce --attention-backend (#1380) · 46094e0c
  Lianmin Zheng authored Sep 10, 2024
  
  46094e0c
09 Sep, 2024 1 commit
- Add torchao quant (int4/int8/fp8) to llama models (#1341) · a7c47e0f
  Jerry Zhang authored Sep 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a7c47e0f
26 Aug, 2024 1 commit
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 3 commits
- Re-organize CI tests (#1052) · c877292c
  Lianmin Zheng authored Aug 12, 2024
  
  c877292c
- Add longer accuracy test on CI (#1049) · 41598e0d
  Lianmin Zheng authored Aug 12, 2024
  
  41598e0d
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
07 Aug, 2024 1 commit
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 2 commits
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
02 Aug, 2024 1 commit
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a