Commits · 7ca751ff7d8ddb341cb22cf000c0e8ce5fc1bb4d · change / sglang · GitLab

27 Dec, 2024 4 commits
- Fused moe triton cfg opt for rocm (#2612) · 7ca751ff
  kk authored Dec 27, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  7ca751ff
- Update CODEOWNERS (#2608) · c75adfec
  Lianmin Zheng authored Dec 26, 2024
  
  c75adfec
- Regression fix to AMD/ROCm from recent change (#2606) · 7722c11c
  HAI authored Dec 26, 2024
  
  7722c11c
- Tiny code cleanup in tokenizer_manager.py (#2586) · b2ed5c8e
  fzyzcjy authored Dec 27, 2024
  
  b2ed5c8e
26 Dec, 2024 18 commits
- Update README.md (#2605) · f46f394f
  Lianmin Zheng authored Dec 26, 2024
  
  f46f394f
- Update contributor_guide.md (#2603) · 2125898a
  Lianmin Zheng authored Dec 26, 2024
  
  2125898a
- Super tiny typo fix (#2564) · 44f011d2
  fzyzcjy authored Dec 27, 2024
  
  44f011d2
- [UTILS] improve makefile a bit by adding help info (#2570) · ed91e003
  kzhou003 authored Dec 26, 2024
```
Co-authored-by: Hongpeng Guo <hpguo@anyscale.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
Co-authored-by: yigex <yigex@amd.com>
```
  ed91e003
- fix: package data missing (#2521) · 531d6ea9
  yudian0504 authored Dec 27, 2024
  
  531d6ea9
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
- [unittest] add unit test to test quant args of srt engine (#2574) · a74d1941
  Zhizhou Sha authored Dec 26, 2024
  
  a74d1941
- Fix duplicated handling of GetWeightsByNameReqInput (#2565) · 3169e66c
  fzyzcjy authored Dec 26, 2024
  
  3169e66c
- Fix logprob_start_len for multi modal models (#2597) · 77395154
  Lianmin Zheng authored Dec 26, 2024
```
Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>
```
  77395154
- update readme of DeepSeek V3 (#2596) · 637de9e8
  fsygd authored Dec 26, 2024
  
  637de9e8
- [Feature] Support new parameter - EBNF in xgrammar (#2526) · acb34072
  Adarsh Shirawalmath authored Dec 26, 2024
  
  acb34072
- Error occurs when loading the gemma model in bitsandbytes format. (#2557) · 08effbff
  Sangchun Ha (Patrick) authored Dec 26, 2024
  
  08effbff
- Update README.md (#2594) · 60bd3272
  Lianmin Zheng authored Dec 26, 2024
  
  60bd3272
- Fix cache hit rate when chunked prefill (#2555) · e7ebecf8
  Liangsheng Yin authored Dec 26, 2024
  
  e7ebecf8
- h100 tuning fused_moe_triton for qwen2 moe (#2560) · 9a23c484
  Xiaoyu Zhang authored Dec 26, 2024
  
  9a23c484
- docs: update deepseek v3 example (#2592) · 635a0426
  Yineng Zhang authored Dec 26, 2024
  
  635a0426
- fix: only enable moe_align_block_size for now (#2590) · 2dccecf4
  Yineng Zhang authored Dec 26, 2024
  
  2dccecf4
- docs: add deepseek v3 launch instructions (#2589) · 75ad0a14
  Yineng Zhang authored Dec 26, 2024
  
  75ad0a14
25 Dec, 2024 5 commits
- chore: bump v0.4.1 (#2582) · efc52f85
  Yineng Zhang authored Dec 26, 2024
  
  efc52f85
- use sgl-kernel moe_align_block_size (#2581) · 60e2fdcf
  Yineng Zhang authored Dec 26, 2024
```
Co-authored-by: ispobock <ispobaoke@163.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  60e2fdcf
- chore: bump 0.0.2.post8 for sgl-kernel (#2580) · d7c0e872
  Yineng Zhang authored Dec 26, 2024
  
  d7c0e872
- fix moe_align_block_size_kernel for shared memory issue (#2579) · 31548116
  Yineng Zhang authored Dec 26, 2024
```
Co-authored-by: ispobock <ispobaoke@163.com>
```
  31548116
- Refactor MoE (#2575) · 53aed988
  HandH1998 authored Dec 26, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  53aed988
24 Dec, 2024 1 commit
- [Bench] Flush cache before benchmarking (#2566) · 8a56b431
  Ying Sheng authored Dec 23, 2024
  
  8a56b431
23 Dec, 2024 3 commits
- Reorg moe code (#2563) · e835a500
  Ke Bao authored Dec 24, 2024
  
  e835a500
- Fix gemlite import (#2553) · 23e5e50f
  Lianmin Zheng authored Dec 22, 2024
  
  23e5e50f
- Doc: Update Grammar Backend (#2545) · 25e5d589
  Shi Shuai authored Dec 23, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  25e5d589
22 Dec, 2024 5 commits
- A better aio rwlock that guarantees the order (#2547) · 41b1db69
  Lianmin Zheng authored Dec 22, 2024
  
  41b1db69
- [Misc] Fix metrics, weight update lock, request logging (#2543) · 84967019
  Lianmin Zheng authored Dec 22, 2024
  
  84967019
- [kernel optimize] benchmark write_req_to_token_pool_triton and optimize kernel (#2509) · 7d672d27
  Xiaoyu Zhang authored Dec 22, 2024
  
  7d672d27
- docs: update sponsorship (DataCrunch) (#2523) · d4b17481
  Yineng Zhang authored Dec 22, 2024
  
  d4b17481
- Add lora_paths to v1_chat_generate_request (#2529) · 19ba2b0e
  Lei authored Dec 22, 2024
  
  19ba2b0e
21 Dec, 2024 2 commits
- fix #2528 (#2541) · 4e1e3cff
  Yineng Zhang authored Dec 22, 2024
  
  4e1e3cff
- chore: bump v0.4.0.post2 (#2525) · 8f4d04e5
  Yineng Zhang authored Dec 21, 2024
  
  8f4d04e5
20 Dec, 2024 1 commit
- Add integration with gemlite weight only quant (#2528) · feb2b768
  Jerry Zhang authored Dec 20, 2024
  
  feb2b768
19 Dec, 2024 1 commit
- fix followup #2517 (#2524) · d95a5f5b
  Yineng Zhang authored Dec 19, 2024
  
  d95a5f5b