Commits · 9c05c6898e262b1f7dd07b1401918be2d48fe4e2 · change / sglang · GitLab

29 Dec, 2024 5 commits
- Add llama_eagle.py (#2640) · 9c05c689
  Lianmin Zheng authored Dec 29, 2024
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  9c05c689
- minor: add nsys cli for docker dev (#2639) · 3464e57b
  Yineng Zhang authored Dec 29, 2024
  
  3464e57b
- Clean up wrapper in flashinfer backend (#2638) · 3815b23c
  Lianmin Zheng authored Dec 29, 2024
  
  3815b23c
- [Docs] Add EBNF to sampling params docs (#2609) · fd34f2da
  Adarsh Shirawalmath authored Dec 29, 2024
  
  fd34f2da
- [Feature] Function Calling (#2544) · 8ee9a850
  Tanjiro authored Dec 29, 2024
```
Co-authored-by: Haoyu Wang <120358163+HaoyuWang4188@users.noreply.github.com>
```
  8ee9a850
28 Dec, 2024 7 commits
- Add `update_weights_from_tensor` (#2631) · fd28640d
  fzyzcjy authored Dec 29, 2024
  
  fd28640d
- add configs for block fp8 related kernels (#2628) · 7863e436
  Yineng Zhang authored Dec 28, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  7863e436
- [docs]Refactor constrained decoding tutorial (#2633) · 333e3bfd
  Shi Shuai authored Dec 28, 2024
  
  333e3bfd
- Docs: Add constrained decoding tutorial (#2614) · 239c9d4d
  Shi Shuai authored Dec 28, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  239c9d4d
- [CI] Fix nightly test and raise better error message (#2626) · 855d0ba3
  Lianmin Zheng authored Dec 27, 2024
```
Co-authored-by: Sangbin <rkooo567@gmail.com>
```
  855d0ba3
- avoid fused_moe_triton `padding` circular import (#2624) · 9254a33a
  Xiaoyu Zhang authored Dec 28, 2024
  
  9254a33a
- Update readme (#2625) · 8a2681e2
  Ke Bao authored Dec 28, 2024
  
  8a2681e2
27 Dec, 2024 13 commits
- Add more supporting organizations (#2623) · 5276a675
  Lianmin Zheng authored Dec 27, 2024
  
  5276a675
- [minor] clean up docs and eos id (#2622) · 751e5ca2
  Lianmin Zheng authored Dec 27, 2024
  
  751e5ca2
- [FIX] Update EOS from config (#2475) · 7a7ac6be
  Yang Zheng authored Dec 28, 2024
  
  7a7ac6be
- docs: update README (#2618) · d9e6ee38
  Yineng Zhang authored Dec 28, 2024
  
  d9e6ee38
- chore: bump v0.4.1.post1 (#2616) · ef5b0ff9
  Yineng Zhang authored Dec 28, 2024
  
  ef5b0ff9
- update sgl_moe_align_block_size usage (#2617) · 6e530515
  HandH1998 authored Dec 28, 2024
  
  6e530515
- fix moe_align_block_size (#2615) · 77d1210b
  HandH1998 authored Dec 27, 2024
  
  77d1210b
- Change extend attention kernel launch parameter for ROCm platform to … (#2610) · 70dc2fbe
  kk authored Dec 27, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
```
  70dc2fbe
- Fix triton kernel performance regression (#2611) · b438a2e5
  kk authored Dec 27, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  b438a2e5
- Fused moe triton cfg opt for rocm (#2612) · 7ca751ff
  kk authored Dec 27, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  7ca751ff
- Update CODEOWNERS (#2608) · c75adfec
  Lianmin Zheng authored Dec 26, 2024
  
  c75adfec
- Regression fix to AMD/ROCm from recent change (#2606) · 7722c11c
  HAI authored Dec 26, 2024
  
  7722c11c
- Tiny code cleanup in tokenizer_manager.py (#2586) · b2ed5c8e
  fzyzcjy authored Dec 27, 2024
  
  b2ed5c8e
26 Dec, 2024 15 commits
- Update README.md (#2605) · f46f394f
  Lianmin Zheng authored Dec 26, 2024
  
  f46f394f
- Update contributor_guide.md (#2603) · 2125898a
  Lianmin Zheng authored Dec 26, 2024
  
  2125898a
- Super tiny typo fix (#2564) · 44f011d2
  fzyzcjy authored Dec 27, 2024
  
  44f011d2
- [UTILS] improve makefile a bit by adding help info (#2570) · ed91e003
  kzhou003 authored Dec 26, 2024
```
Co-authored-by: Hongpeng Guo <hpguo@anyscale.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
Co-authored-by: yigex <yigex@amd.com>
```
  ed91e003
- fix: package data missing (#2521) · 531d6ea9
  yudian0504 authored Dec 27, 2024
  
  531d6ea9
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
- [unittest] add unit test to test quant args of srt engine (#2574) · a74d1941
  Zhizhou Sha authored Dec 26, 2024
  
  a74d1941
- Fix duplicated handling of GetWeightsByNameReqInput (#2565) · 3169e66c
  fzyzcjy authored Dec 26, 2024
  
  3169e66c
- Fix logprob_start_len for multi modal models (#2597) · 77395154
  Lianmin Zheng authored Dec 26, 2024
```
Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>
```
  77395154
- update readme of DeepSeek V3 (#2596) · 637de9e8
  fsygd authored Dec 26, 2024
  
  637de9e8
- [Feature] Support new parameter - EBNF in xgrammar (#2526) · acb34072
  Adarsh Shirawalmath authored Dec 26, 2024
  
  acb34072
- Error occurs when loading the gemma model in bitsandbytes format. (#2557) · 08effbff
  Sangchun Ha (Patrick) authored Dec 26, 2024
  
  08effbff
- Update README.md (#2594) · 60bd3272
  Lianmin Zheng authored Dec 26, 2024
  
  60bd3272
- Fix cache hit rate when chunked prefill (#2555) · e7ebecf8
  Liangsheng Yin authored Dec 26, 2024
  
  e7ebecf8
- h100 tuning fused_moe_triton for qwen2 moe (#2560) · 9a23c484
  Xiaoyu Zhang authored Dec 26, 2024
  
  9a23c484