Commits · 8b6ce52e92ab390952e75e2fc68c90d4e3f7928c · change / sglang

16 Jan, 2025 1 commit
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
15 Jan, 2025 1 commit
- chore: bump v0.4.1.post6 (#2899) · b3e99dfb
  Yineng Zhang authored Jan 15, 2025
  
  b3e99dfb
13 Jan, 2025 2 commits
- docs: update link (#2857) · 41d7e5b7
  Yineng Zhang authored Jan 13, 2025
  
  41d7e5b7
- Fix linear.py and improve weight loading (#2851) · 72c77763
  Lianmin Zheng authored Jan 13, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  72c77763
11 Jan, 2025 2 commits
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e
- chore: bump v0.4.1.post5 (#2840) · f624901c
  Yineng Zhang authored Jan 11, 2025
  
  f624901c
10 Jan, 2025 1 commit
- Doc: add block-wise FP8 in dpsk model reference (#2830) · 5cc11705
  Chayenne authored Jan 10, 2025
  
  5cc11705
09 Jan, 2025 1 commit
- [Doc]: Deepseek reference docs (#2787) · 11fffbc9
  Xiaotong Jiang authored Jan 09, 2025
  
  11fffbc9
08 Jan, 2025 2 commits
- Docs：Update the style of llma 3.1 405B docs (#2789) · 2e6346fc
  Chayenne authored Jan 08, 2025
  
  2e6346fc
- Docs: Rewrite docs for LLama 405B and ModelSpace (#2773) · 977f785d
  mlmz authored Jan 08, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  977f785d
05 Jan, 2025 1 commit
- chore: bump v0.4.1.post4 (#2713) · 2f0d3864
  Yineng Zhang authored Jan 06, 2025
  
  2f0d3864
03 Jan, 2025 1 commit
- Fix package loss for small models (#2717) · 0f9cc6d8
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: sdli1995 < mmlmonkey@163.com>
```
  0f9cc6d8
02 Jan, 2025 1 commit
- Docs: Update documentation workflow and contribution guide (#2704) · dd2e2d27
  Shi Shuai authored Jan 02, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  dd2e2d27
01 Jan, 2025 1 commit
- [Docs] Add Support for Pydantic Structured Output Format (#2697) · 062c48d2
  Shi Shuai authored Jan 01, 2025
  
  062c48d2
31 Dec, 2024 3 commits
- Doc: Rename contribution_guide.md (#2691) · 0d8d97b8
  Chayenne authored Dec 31, 2024
  
  0d8d97b8
- Docs: Refactor Contribution Guide (#2690) · 0a765bbc
  Shi Shuai authored Dec 31, 2024
  
  0a765bbc
- feat: use CUDA 12.4 by default (for FA3) (#2682) · d49b13c6
  Yineng Zhang authored Dec 31, 2024
  
  d49b13c6
30 Dec, 2024 3 commits
- Update structured_outputs.ipynb (#2666) · bdd2827a
  Lianmin Zheng authored Dec 30, 2024
  
  bdd2827a
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
- docs: update README (#2651) · 098d659c
  Yineng Zhang authored Dec 30, 2024
  
  098d659c
29 Dec, 2024 5 commits
- Release 0.4.1.post3 - upload the config.json to PyPI (#2647) · 03d5fbfd
  Lianmin Zheng authored Dec 29, 2024
  
  03d5fbfd
- docs: add development guide using docker (#2645) · b085e06b
  Yineng Zhang authored Dec 30, 2024
  
  b085e06b
- chore: bump v0.4.1.post2 (#2643) · 3ccf566b
  Yineng Zhang authored Dec 30, 2024
  
  3ccf566b
- [Docs] Add EBNF to sampling params docs (#2609) · fd34f2da
  Adarsh Shirawalmath authored Dec 29, 2024
  
  fd34f2da
- [Feature] Function Calling (#2544) · 8ee9a850
  Tanjiro authored Dec 29, 2024
```
Co-authored-by: Haoyu Wang <120358163+HaoyuWang4188@users.noreply.github.com>
```
  8ee9a850
28 Dec, 2024 2 commits
- [docs]Refactor constrained decoding tutorial (#2633) · 333e3bfd
  Shi Shuai authored Dec 28, 2024
  
  333e3bfd
- Docs: Add constrained decoding tutorial (#2614) · 239c9d4d
  Shi Shuai authored Dec 28, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  239c9d4d
27 Dec, 2024 2 commits
- [minor] clean up docs and eos id (#2622) · 751e5ca2
  Lianmin Zheng authored Dec 27, 2024
  
  751e5ca2
- chore: bump v0.4.1.post1 (#2616) · ef5b0ff9
  Yineng Zhang authored Dec 28, 2024
  
  ef5b0ff9
26 Dec, 2024 3 commits
- Update contributor_guide.md (#2603) · 2125898a
  Lianmin Zheng authored Dec 26, 2024
  
  2125898a
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
- Fix logprob_start_len for multi modal models (#2597) · 77395154
  Lianmin Zheng authored Dec 26, 2024
```
Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>
```
  77395154
25 Dec, 2024 1 commit
- chore: bump v0.4.1 (#2582) · efc52f85
  Yineng Zhang authored Dec 26, 2024
  
  efc52f85
23 Dec, 2024 1 commit
- Doc: Update Grammar Backend (#2545) · 25e5d589
  Shi Shuai authored Dec 23, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  25e5d589
22 Dec, 2024 1 commit
- [Misc] Fix metrics, weight update lock, request logging (#2543) · 84967019
  Lianmin Zheng authored Dec 22, 2024
  
  84967019
21 Dec, 2024 1 commit
- chore: bump v0.4.0.post2 (#2525) · 8f4d04e5
  Yineng Zhang authored Dec 21, 2024
  
  8f4d04e5
17 Dec, 2024 1 commit
- Print progress bar during cuda graph capture (#2502) · 21e9e63a
  Lianmin Zheng authored Dec 17, 2024
  
  21e9e63a
12 Dec, 2024 1 commit
- Rename rust folder to sgl-router (#2464) · e3b3acfa
  Ata Fatahi authored Dec 12, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  e3b3acfa
11 Dec, 2024 2 commits
- [router] Update doc for dynamic scaling and fault tolerance (#2454) · c0ee46fe
  Byron Hsu authored Dec 11, 2024
  
  c0ee46fe
- Add support for IBM Granite 3.x models (#2437) · 993956c6
  Fred Reiss authored Dec 11, 2024
  
  993956c6