Commits · 8b6ce52e92ab390952e75e2fc68c90d4e3f7928c · change / sglang · GitLab

16 Jan, 2025 1 commit
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
13 Jan, 2025 2 commits
- docs: update link (#2857) · 41d7e5b7
  Yineng Zhang authored Jan 13, 2025
  
  41d7e5b7
- Fix linear.py and improve weight loading (#2851) · 72c77763
  Lianmin Zheng authored Jan 13, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  72c77763
11 Jan, 2025 1 commit
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e
10 Jan, 2025 1 commit
- Doc: add block-wise FP8 in dpsk model reference (#2830) · 5cc11705
  Chayenne authored Jan 10, 2025
  
  5cc11705
09 Jan, 2025 1 commit
- [Doc]: Deepseek reference docs (#2787) · 11fffbc9
  Xiaotong Jiang authored Jan 09, 2025
  
  11fffbc9
08 Jan, 2025 2 commits
- Docs：Update the style of llma 3.1 405B docs (#2789) · 2e6346fc
  Chayenne authored Jan 08, 2025
  
  2e6346fc
- Docs: Rewrite docs for LLama 405B and ModelSpace (#2773) · 977f785d
  mlmz authored Jan 08, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  977f785d
03 Jan, 2025 1 commit
- Fix package loss for small models (#2717) · 0f9cc6d8
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: sdli1995 < mmlmonkey@163.com>
```
  0f9cc6d8
02 Jan, 2025 1 commit
- Docs: Update documentation workflow and contribution guide (#2704) · dd2e2d27
  Shi Shuai authored Jan 02, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  dd2e2d27
01 Jan, 2025 1 commit
- [Docs] Add Support for Pydantic Structured Output Format (#2697) · 062c48d2
  Shi Shuai authored Jan 01, 2025
  
  062c48d2
31 Dec, 2024 1 commit
- Docs: Refactor Contribution Guide (#2690) · 0a765bbc
  Shi Shuai authored Dec 31, 2024
  
  0a765bbc
30 Dec, 2024 1 commit
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
29 Dec, 2024 1 commit
- [Docs] Add EBNF to sampling params docs (#2609) · fd34f2da
  Adarsh Shirawalmath authored Dec 29, 2024
  
  fd34f2da
27 Dec, 2024 1 commit
- [minor] clean up docs and eos id (#2622) · 751e5ca2
  Lianmin Zheng authored Dec 27, 2024
  
  751e5ca2
26 Dec, 2024 3 commits
- Update contributor_guide.md (#2603) · 2125898a
  Lianmin Zheng authored Dec 26, 2024
  
  2125898a
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
- Fix logprob_start_len for multi modal models (#2597) · 77395154
  Lianmin Zheng authored Dec 26, 2024
```
Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>
```
  77395154
22 Dec, 2024 1 commit
- [Misc] Fix metrics, weight update lock, request logging (#2543) · 84967019
  Lianmin Zheng authored Dec 22, 2024
  
  84967019
17 Dec, 2024 1 commit
- Print progress bar during cuda graph capture (#2502) · 21e9e63a
  Lianmin Zheng authored Dec 17, 2024
  
  21e9e63a
11 Dec, 2024 1 commit
- Add support for IBM Granite 3.x models (#2437) · 993956c6
  Fred Reiss authored Dec 11, 2024
  
  993956c6
08 Dec, 2024 1 commit
- nit: Remove busy waiting on scheduler (#2382) · 1f09e84b
  SangBin Cho authored Dec 08, 2024
  
  1f09e84b
06 Dec, 2024 2 commits
- Fix the overlap for xgrammar (#2377) · 0e7409ad
  Lianmin Zheng authored Dec 06, 2024
  
  0e7409ad
- docs: Improve instructions for supporting new models (#2363) · 3cde5eb6
  vchzls authored Dec 06, 2024
```
Co-authored-by: zhaohoulong <zhaohoulong@xiaomi.com>
```
  3cde5eb6
27 Nov, 2024 1 commit
- add profile in offline benchmark & update doc (#2123) · 91e5dbf5
  bjmsong authored Nov 28, 2024
```
Co-authored-by: root <bjmsong@126.com>
```
  91e5dbf5
26 Nov, 2024 1 commit
- Input_embeds support (#2052) · 1aea19f6
  Rin Intachuen authored Nov 25, 2024
  
  1aea19f6
24 Nov, 2024 1 commit
- Simplify batch update (#2154) · c211e7b6
  Lianmin Zheng authored Nov 24, 2024
  
  c211e7b6
22 Nov, 2024 1 commit
- Rename sglang.bench_latency to sglang.bench_one_batch (#2118) · dfec7fca
  Lianmin Zheng authored Nov 21, 2024
  
  dfec7fca
18 Nov, 2024 1 commit

add phi-3 small support (#2062) · 8c280cee

Tanjiro authored Nov 17, 2024


Co-authored-by: Tushar Goel <114812108+AI-Tushar@users.noreply.github.com>

8c280cee

15 Nov, 2024 2 commits
- fix small typos in docs (#2047) · 023d0a73
  Xiaoyu Zhang authored Nov 16, 2024
  
  023d0a73
- fix: align enable_overlap_scheduler naming between code and docs (#2038) · 29ebe3df
  ws authored Nov 15, 2024
  
  29ebe3df
11 Nov, 2024 1 commit
- support internlm2-reward (#1994) · f18b9c72
  RangiLyu authored Nov 12, 2024
  
  f18b9c72
08 Nov, 2024 3 commits
- Gemma2 reward model support (#1954) · f16eb15d
  aqweteddy authored Nov 08, 2024
  
  f16eb15d
- Monitoring documentation (#1933) · 5bc2508b
  Yudi Xue authored Nov 07, 2024
  
  5bc2508b
- [Doc] fix docs (#1949) · 1ae270c5
  Lianmin Zheng authored Nov 07, 2024
  
  1ae270c5
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
05 Nov, 2024 1 commit
- [Doc] improve relative links and structure (#1924) · f5113e50
  Lianmin Zheng authored Nov 05, 2024
  
  f5113e50
03 Nov, 2024 2 commits
- Fix regex docs (#1909) · 1853c352
  Lianmin Zheng authored Nov 03, 2024
  
  1853c352
- Simplify tokenizer manager (#1899) · 838dcda1
  Lianmin Zheng authored Nov 03, 2024
  
  838dcda1
02 Nov, 2024 1 commit
- Fix docs (#1890) · be7986e0
  Lianmin Zheng authored Nov 02, 2024
  
  be7986e0