Commits · 70817a7eae0055cb3c98c7827b73b8058fb342f4 · change / sglang · GitLab

04 Feb, 2025 1 commit
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
31 Jan, 2025 1 commit
- add tuning block wise fp8 (#3242) · 7b020cca
  Yineng Zhang authored Feb 01, 2025
```
Co-authored-by: HandH1998 <007aabbcc411@gmail.com>
```
  7b020cca
27 Jan, 2025 1 commit
- add dsv3 mi300 triton config for block scale (#3146) · 351a72d4
  yigex authored Jan 27, 2025
  
  351a72d4
26 Jan, 2025 1 commit
- Use torch.compile for scaling penalty (#3133) · 27acf63b
  Lianmin Zheng authored Jan 25, 2025
  
  27acf63b
23 Jan, 2025 1 commit
- support lightning_attention_decode in sgl-kernel for MiniMax-Text-01 (#3030) · ac2dc35d
  Xiaoyu Zhang authored Jan 23, 2025
  
  ac2dc35d
20 Jan, 2025 1 commit
- fix moe align blocks benchmark (#3003) · 10bfce71
  yiakwy-xpu-ml-framework-team authored Jan 20, 2025
  
  10bfce71
19 Jan, 2025 1 commit
- fix file name spelling mistake and useless variable in minmax-text-01-lightning_attention (#2971) · 83452dbb
  Xiaoyu Zhang authored Jan 19, 2025
  
  83452dbb
18 Jan, 2025 2 commits
- optimize MiniMax-Text-01 lightning_attn_decode triton (#2966) · c2f212d6
  Xiaoyu Zhang authored Jan 18, 2025
  
  c2f212d6
- Multi-turn benchmark for hierarchical caching (#2942) · 13387e6b
  Zhiqiang Xie authored Jan 17, 2025
  
  13387e6b
16 Jan, 2025 3 commits
- [kernel] MiniMax-Text-01 decode lightning_attn with triton (#2920) · 78e974b2
  Xiaoyu Zhang authored Jan 17, 2025
  
  78e974b2
- Improve type annotation and styles (#2926) · bc6915e3
  Lianmin Zheng authored Jan 16, 2025
  
  bc6915e3
- [kernel] MiniMax-Text-01 prefill lightning_attn with triton (#2911) · ab317936
  Xiaoyu Zhang authored Jan 16, 2025
  
  ab317936
14 Jan, 2025 1 commit
- docs: update README (#2878) · 80002562
  Yineng Zhang authored Jan 14, 2025
  
  80002562
13 Jan, 2025 5 commits
- Add a new api configure_logging to allow dumping the requests (#2875) · 46d44318
  Lianmin Zheng authored Jan 13, 2025
  
  46d44318
- Sampling penalties memory interface (#2870) · d08c77c4
  Xiaoyu Zhang authored Jan 13, 2025
  
  d08c77c4
- docs: update link (#2857) · 41d7e5b7
  Yineng Zhang authored Jan 13, 2025
  
  41d7e5b7
- Fix linear.py and improve weight loading (#2851) · 72c77763
  Lianmin Zheng authored Jan 13, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  72c77763
- Add int8 quant kernel (#2848) · 85b2e057
  Ke Bao authored Jan 13, 2025
  
  85b2e057
11 Jan, 2025 2 commits
- docs: update README (#2841) · 197cbf9b
  Yineng Zhang authored Jan 11, 2025
  
  197cbf9b
- chore: bump v0.4.1.post5 (#2840) · f624901c
  Yineng Zhang authored Jan 11, 2025
  
  f624901c
09 Jan, 2025 1 commit
- minor: support specifying local dataset path for gsm8k and hellaswag (#2816) · 4f077c01
  sleepcoo authored Jan 09, 2025
  
  4f077c01
07 Jan, 2025 2 commits
- Misc fix for min_p_sampling, --cuda-graph-bs (#2761) · bdc1acf6
  Lianmin Zheng authored Jan 07, 2025
  
  bdc1acf6
- add benchmark_moe_align_blocks (#2767) · 380930a9
  Xiaoyu Zhang authored Jan 07, 2025
  
  380930a9
02 Jan, 2025 2 commits
- Included multi-node DeepSeekv3 example (#2707) · a990daff
  Rodrigo Garcia authored Jan 02, 2025
  
  a990daff
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
30 Dec, 2024 3 commits
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
- docs: update README (#2651) · 098d659c
  Yineng Zhang authored Dec 30, 2024
  
  098d659c
- add 2*h20 node serving example for deepseek v3 (#2650) · 76d14f8c
  Lzhang-hub authored Dec 30, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  76d14f8c
29 Dec, 2024 3 commits
- Release 0.4.1.post3 - upload the config.json to PyPI (#2647) · 03d5fbfd
  Lianmin Zheng authored Dec 29, 2024
  
  03d5fbfd
- docs: update README (#2644) · 763dd55d
  Yineng Zhang authored Dec 30, 2024
  
  763dd55d
- Update Triton configs for block fp8 kernels (#2641) · afa0341e
  HandH1998 authored Dec 29, 2024
  
  afa0341e
28 Dec, 2024 2 commits
- add configs for block fp8 related kernels (#2628) · 7863e436
  Yineng Zhang authored Dec 28, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  7863e436
- Update readme (#2625) · 8a2681e2
  Ke Bao authored Dec 28, 2024
  
  8a2681e2
27 Dec, 2024 1 commit
- docs: update README (#2618) · d9e6ee38
  Yineng Zhang authored Dec 28, 2024
  
  d9e6ee38
26 Dec, 2024 6 commits
- Update README.md (#2605) · f46f394f
  Lianmin Zheng authored Dec 26, 2024
  
  f46f394f
- Fix logprob_start_len for multi modal models (#2597) · 77395154
  Lianmin Zheng authored Dec 26, 2024
```
Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>
```
  77395154
- update readme of DeepSeek V3 (#2596) · 637de9e8
  fsygd authored Dec 26, 2024
  
  637de9e8
- h100 tuning fused_moe_triton for qwen2 moe (#2560) · 9a23c484
  Xiaoyu Zhang authored Dec 26, 2024
  
  9a23c484
- docs: update deepseek v3 example (#2592) · 635a0426
  Yineng Zhang authored Dec 26, 2024
  
  635a0426
- docs: add deepseek v3 launch instructions (#2589) · 75ad0a14
  Yineng Zhang authored Dec 26, 2024
  
  75ad0a14