Commits · bedc4c7a50fe4ffb98b8f76bf3fa08ff1cf47a13 · change / sglang · GitLab

31 Dec, 2024 6 commits
- misc: update CODEOWNERS (#2680) · bedc4c7a
  Yineng Zhang authored Dec 31, 2024
  
  bedc4c7a
- Support target model verification in the attention backend (#2678) · f44d1439
  Lianmin Zheng authored Dec 30, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  f44d1439
- minor: cleanup sgl-kernel (#2679) · b6b57fc2
  Yineng Zhang authored Dec 31, 2024
  
  b6b57fc2
- Add cutlass submodule for sgl-kernel (#2676) · b4403985
  Ke Bao authored Dec 31, 2024
  
  b4403985
- Improve the computation for time_per_output_token Prometheus metrics (#2674) · 339c69a2
  Lianmin Zheng authored Dec 30, 2024
  
  339c69a2
- CI: Update scripts to fail fast (#2672) · f7074700
  fzyzcjy authored Dec 31, 2024
  
  f7074700
30 Dec, 2024 12 commits
- Minor follow-up fixes for the logprob refactor (#2670) · 21ec66e5
  Lianmin Zheng authored Dec 30, 2024
  
  21ec66e5
- AMD DeepSeek_V3 FP8 Numerical fix (#2667) · c5210dfa
  HAI authored Dec 30, 2024
  
  c5210dfa
- Add GemLite caching after each capture (#2669) · a29dd950
  mobicham authored Dec 30, 2024
  
  a29dd950
- Refactor logprob computation to return the real logprob used in sampling (#2664) · 9c6ba248
  Lianmin Zheng authored Dec 30, 2024
  
  9c6ba248
- Refactor sgl-kernel build (#2642) · b02da24a
  Ke Bao authored Dec 30, 2024
  
  b02da24a
- Update structured_outputs.ipynb (#2666) · bdd2827a
  Lianmin Zheng authored Dec 30, 2024
  
  bdd2827a
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
- fix typo in python/sglang/srt/layers/quantization/fp8.py (#2655) · e6f523b5
  HAI authored Dec 29, 2024
  
  e6f523b5
- Revert "[feat] Add math eval to CI" (#2656) · 32318178
  Lianmin Zheng authored Dec 29, 2024
  
  32318178
- [feat] Add math eval to CI (#2652) · a11f8d5f
  Xiaotong Jiang authored Dec 29, 2024
  
  a11f8d5f
- docs: update README (#2651) · 098d659c
  Yineng Zhang authored Dec 30, 2024
  
  098d659c
- add 2*h20 node serving example for deepseek v3 (#2650) · 76d14f8c
  Lzhang-hub authored Dec 30, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  76d14f8c
29 Dec, 2024 17 commits
- Update the timeout in nightly-test.yml (#2649) · b08c308e
  Lianmin Zheng authored Dec 29, 2024
  
  b08c308e
- Release 0.4.1.post3 - upload the config.json to PyPI (#2647) · 03d5fbfd
  Lianmin Zheng authored Dec 29, 2024
  
  03d5fbfd
- CI: skip special token for engine token ids unit test (#2648) · 1703d766
  Chayenne authored Dec 29, 2024
  
  1703d766
- Merge branch 'main' of github.com:sgl-project/sglang · 09e6e2aa
  zhaochenyang20 authored Dec 29, 2024
  
  09e6e2aa
- CI: Fix unittest for engine input token ids and output token ids (#2646) · fad29f7f
  Shi Shuai authored Dec 29, 2024
  
  fad29f7f
- [Feature] Get Token IDs with Engine.generate() (#2636) · 35bdb485
  Shi Shuai authored Dec 29, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  35bdb485
- docs: add development guide using docker (#2645) · b085e06b
  Yineng Zhang authored Dec 30, 2024
  
  b085e06b
- docs: update README (#2644) · 763dd55d
  Yineng Zhang authored Dec 30, 2024
  
  763dd55d
- chore: bump v0.4.1.post2 (#2643) · 3ccf566b
  Yineng Zhang authored Dec 30, 2024
  
  3ccf566b
- Update Triton configs for block fp8 kernels (#2641) · afa0341e
  HandH1998 authored Dec 29, 2024
  
  afa0341e
- AMD: set weights and scaling numbers properly for block FP8 (#2637) · 30828e71
  HAI authored Dec 29, 2024
  
  30828e71
- [Session] Update session control interface (#2635) · e0e09fce
  Ying Sheng authored Dec 29, 2024
  
  e0e09fce
- Add llama_eagle.py (#2640) · 9c05c689
  Lianmin Zheng authored Dec 29, 2024
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  9c05c689
- minor: add nsys cli for docker dev (#2639) · 3464e57b
  Yineng Zhang authored Dec 29, 2024
  
  3464e57b
- Clean up wrapper in flashinfer backend (#2638) · 3815b23c
  Lianmin Zheng authored Dec 29, 2024
  
  3815b23c
- [Docs] Add EBNF to sampling params docs (#2609) · fd34f2da
  Adarsh Shirawalmath authored Dec 29, 2024
  
  fd34f2da
- [Feature] Function Calling (#2544) · 8ee9a850
  Tanjiro authored Dec 29, 2024
```
Co-authored-by: Haoyu Wang <120358163+HaoyuWang4188@users.noreply.github.com>
```
  8ee9a850
28 Dec, 2024 5 commits
- Add `update_weights_from_tensor` (#2631) · fd28640d
  fzyzcjy authored Dec 29, 2024
  
  fd28640d
- add configs for block fp8 related kernels (#2628) · 7863e436
  Yineng Zhang authored Dec 28, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  7863e436
- [docs]Refactor constrained decoding tutorial (#2633) · 333e3bfd
  Shi Shuai authored Dec 28, 2024
  
  333e3bfd
- Docs: Add constrained decoding tutorial (#2614) · 239c9d4d
  Shi Shuai authored Dec 28, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  239c9d4d
- [CI] Fix nightly test and raise better error message (#2626) · 855d0ba3
  Lianmin Zheng authored Dec 27, 2024
```
Co-authored-by: Sangbin <rkooo567@gmail.com>
```
  855d0ba3