Commits · 239c9d4d3a40841b1323db700b1e351d3565e7e4 · zhaoyu6 / sglang

"vscode:/vscode.git/clone" did not exist on "e114689e49250b59f23c473c8783fbba6c41451d"

28 Dec, 2024 4 commits
- Docs: Add constrained decoding tutorial (#2614) · 239c9d4d
  Shi Shuai authored Dec 28, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  239c9d4d
- [CI] Fix nightly test and raise better error message (#2626) · 855d0ba3
  Lianmin Zheng authored Dec 27, 2024
```
Co-authored-by: Sangbin <rkooo567@gmail.com>
```
  855d0ba3
- avoid fused_moe_triton `padding` circular import (#2624) · 9254a33a
  Xiaoyu Zhang authored Dec 28, 2024
  
  9254a33a
- Update readme (#2625) · 8a2681e2
  Ke Bao authored Dec 28, 2024
  
  8a2681e2
27 Dec, 2024 13 commits
- Add more supporting organizations (#2623) · 5276a675
  Lianmin Zheng authored Dec 27, 2024
  
  5276a675
- [minor] clean up docs and eos id (#2622) · 751e5ca2
  Lianmin Zheng authored Dec 27, 2024
  
  751e5ca2
- [FIX] Update EOS from config (#2475) · 7a7ac6be
  Yang Zheng authored Dec 28, 2024
  
  7a7ac6be
- docs: update README (#2618) · d9e6ee38
  Yineng Zhang authored Dec 28, 2024
  
  d9e6ee38
- chore: bump v0.4.1.post1 (#2616) · ef5b0ff9
  Yineng Zhang authored Dec 28, 2024
  
  ef5b0ff9
- update sgl_moe_align_block_size usage (#2617) · 6e530515
  HandH1998 authored Dec 28, 2024
  
  6e530515
- fix moe_align_block_size (#2615) · 77d1210b
  HandH1998 authored Dec 27, 2024
  
  77d1210b
- Change extend attention kernel launch parameter for ROCm platform to … (#2610) · 70dc2fbe
  kk authored Dec 27, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
```
  70dc2fbe
- Fix triton kernel performance regression (#2611) · b438a2e5
  kk authored Dec 27, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  b438a2e5
- Fused moe triton cfg opt for rocm (#2612) · 7ca751ff
  kk authored Dec 27, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  7ca751ff
- Update CODEOWNERS (#2608) · c75adfec
  Lianmin Zheng authored Dec 26, 2024
  
  c75adfec
- Regression fix to AMD/ROCm from recent change (#2606) · 7722c11c
  HAI authored Dec 26, 2024
  
  7722c11c
- Tiny code cleanup in tokenizer_manager.py (#2586) · b2ed5c8e
  fzyzcjy authored Dec 27, 2024
  
  b2ed5c8e
26 Dec, 2024 18 commits
- Update README.md (#2605) · f46f394f
  Lianmin Zheng authored Dec 26, 2024
  
  f46f394f
- Update contributor_guide.md (#2603) · 2125898a
  Lianmin Zheng authored Dec 26, 2024
  
  2125898a
- Super tiny typo fix (#2564) · 44f011d2
  fzyzcjy authored Dec 27, 2024
  
  44f011d2
- [UTILS] improve makefile a bit by adding help info (#2570) · ed91e003
  kzhou003 authored Dec 26, 2024
```
Co-authored-by: Hongpeng Guo <hpguo@anyscale.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
Co-authored-by: yigex <yigex@amd.com>
```
  ed91e003
- fix: package data missing (#2521) · 531d6ea9
  yudian0504 authored Dec 27, 2024
  
  531d6ea9
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
- [unittest] add unit test to test quant args of srt engine (#2574) · a74d1941
  Zhizhou Sha authored Dec 26, 2024
  
  a74d1941
- Fix duplicated handling of GetWeightsByNameReqInput (#2565) · 3169e66c
  fzyzcjy authored Dec 26, 2024
  
  3169e66c
- Fix logprob_start_len for multi modal models (#2597) · 77395154
  Lianmin Zheng authored Dec 26, 2024
```
Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>
```
  77395154
- update readme of DeepSeek V3 (#2596) · 637de9e8
  fsygd authored Dec 26, 2024
  
  637de9e8
- [Feature] Support new parameter - EBNF in xgrammar (#2526) · acb34072
  Adarsh Shirawalmath authored Dec 26, 2024
  
  acb34072
- Error occurs when loading the gemma model in bitsandbytes format. (#2557) · 08effbff
  Sangchun Ha (Patrick) authored Dec 26, 2024
  
  08effbff
- Update README.md (#2594) · 60bd3272
  Lianmin Zheng authored Dec 26, 2024
  
  60bd3272
- Fix cache hit rate when chunked prefill (#2555) · e7ebecf8
  Liangsheng Yin authored Dec 26, 2024
  
  e7ebecf8
- h100 tuning fused_moe_triton for qwen2 moe (#2560) · 9a23c484
  Xiaoyu Zhang authored Dec 26, 2024
  
  9a23c484
- docs: update deepseek v3 example (#2592) · 635a0426
  Yineng Zhang authored Dec 26, 2024
  
  635a0426
- fix: only enable moe_align_block_size for now (#2590) · 2dccecf4
  Yineng Zhang authored Dec 26, 2024
  
  2dccecf4
- docs: add deepseek v3 launch instructions (#2589) · 75ad0a14
  Yineng Zhang authored Dec 26, 2024
  
  75ad0a14
25 Dec, 2024 5 commits
- chore: bump v0.4.1 (#2582) · efc52f85
  Yineng Zhang authored Dec 26, 2024
  
  efc52f85
- use sgl-kernel moe_align_block_size (#2581) · 60e2fdcf
  Yineng Zhang authored Dec 26, 2024
```
Co-authored-by: ispobock <ispobaoke@163.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  60e2fdcf
- chore: bump 0.0.2.post8 for sgl-kernel (#2580) · d7c0e872
  Yineng Zhang authored Dec 26, 2024
  
  d7c0e872
- fix moe_align_block_size_kernel for shared memory issue (#2579) · 31548116
  Yineng Zhang authored Dec 26, 2024
```
Co-authored-by: ispobock <ispobaoke@163.com>
```
  31548116
- Refactor MoE (#2575) · 53aed988
  HandH1998 authored Dec 26, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  53aed988