Commits · 773951548ddd2d9f98f062788bc1c13aecbcf66d · change / sglang

26 Dec, 2024 1 commit

Fix logprob_start_len for multi modal models (#2597) · 77395154

Lianmin Zheng authored Dec 26, 2024


Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>

77395154

25 Dec, 2024 1 commit
- chore: bump v0.4.1 (#2582) · efc52f85
  Yineng Zhang authored Dec 26, 2024
  
  efc52f85
23 Dec, 2024 1 commit
- Doc: Update Grammar Backend (#2545) · 25e5d589
  Shi Shuai authored Dec 23, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  25e5d589
22 Dec, 2024 1 commit
- [Misc] Fix metrics, weight update lock, request logging (#2543) · 84967019
  Lianmin Zheng authored Dec 22, 2024
  
  84967019
21 Dec, 2024 1 commit
- chore: bump v0.4.0.post2 (#2525) · 8f4d04e5
  Yineng Zhang authored Dec 21, 2024
  
  8f4d04e5
17 Dec, 2024 1 commit
- Print progress bar during cuda graph capture (#2502) · 21e9e63a
  Lianmin Zheng authored Dec 17, 2024
  
  21e9e63a
12 Dec, 2024 1 commit
- Rename rust folder to sgl-router (#2464) · e3b3acfa
  Ata Fatahi authored Dec 12, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  e3b3acfa
11 Dec, 2024 2 commits
- [router] Update doc for dynamic scaling and fault tolerance (#2454) · c0ee46fe
  Byron Hsu authored Dec 11, 2024
  
  c0ee46fe
- Add support for IBM Granite 3.x models (#2437) · 993956c6
  Fred Reiss authored Dec 11, 2024
  
  993956c6
10 Dec, 2024 1 commit
- Typo fix in router.md (#2424) · 2b340adf
  Adarsh Shirawalmath authored Dec 10, 2024
  
  2b340adf
08 Dec, 2024 1 commit
- nit: Remove busy waiting on scheduler (#2382) · 1f09e84b
  SangBin Cho authored Dec 08, 2024
  
  1f09e84b
06 Dec, 2024 3 commits
- Release v0.4.0.post1 (#2375) · e5f227c0
  Lianmin Zheng authored Dec 06, 2024
  
  e5f227c0
- Fix the overlap for xgrammar (#2377) · 0e7409ad
  Lianmin Zheng authored Dec 06, 2024
  
  0e7409ad
- docs: Improve instructions for supporting new models (#2363) · 3cde5eb6
  vchzls authored Dec 06, 2024
```
Co-authored-by: zhaohoulong <zhaohoulong@xiaomi.com>
```
  3cde5eb6
04 Dec, 2024 2 commits
- Add Docs For SGLang Native Router (#2308) · 18ea841f
  Chayenne authored Dec 04, 2024
  
  18ea841f
- Fix Docs CI When Compile Error (#2323) · 786be44d
  Chayenne authored Dec 04, 2024
  
  786be44d
03 Dec, 2024 1 commit
- chore: bump v0.4.0 (#2338) · f8b03269
  Yineng Zhang authored Dec 04, 2024
  
  f8b03269
01 Dec, 2024 2 commits
- Revert "Revert "[FEAT] Support GGUF format"" (#2287) · 4936be8a
  Lianmin Zheng authored Nov 30, 2024
  
  4936be8a
- Revert "[FEAT] Support GGUF format" (#2285) · 7e4c6dd8
  Lianmin Zheng authored Nov 30, 2024
  
  7e4c6dd8
30 Nov, 2024 2 commits
- [FEAT] Support GGUF format (#2215) · 883c9554
  Yang Zheng authored Nov 30, 2024
```
Co-authored-by: Yang Zheng(SW)(Alex) <you@example.com>
```
  883c9554
- udate weights from disk (#2265) · 7d5d1d3d
  Chayenne authored Nov 29, 2024
  
  7d5d1d3d
29 Nov, 2024 3 commits
- chore: bump v0.3.6.post3 (#2259) · fae4e5e9
  Yineng Zhang authored Nov 30, 2024
  
  fae4e5e9
- Update backend.md (#2251) · 4f2ee48e
  Lianmin Zheng authored Nov 28, 2024
  
  4f2ee48e
- Update backend.md (#2250) · 71ff2728
  Lianmin Zheng authored Nov 28, 2024
  
  71ff2728
28 Nov, 2024 1 commit
- Update Install Method 2. From source (#2232) · b79fffdc
  HAI authored Nov 27, 2024
  
  b79fffdc
27 Nov, 2024 2 commits
- add profile in offline benchmark & update doc (#2123) · 91e5dbf5
  bjmsong authored Nov 28, 2024
```
Co-authored-by: root <bjmsong@126.com>
```
  91e5dbf5
- Release v0.3.6.post2 (#2214) · fed4c694
  Lianmin Zheng authored Nov 27, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  fed4c694
26 Nov, 2024 2 commits
- Release v0.3.6.post1 (#2189) · ac5a0f04
  Lianmin Zheng authored Nov 25, 2024
  
  ac5a0f04
- Input_embeds support (#2052) · 1aea19f6
  Rin Intachuen authored Nov 25, 2024
  
  1aea19f6
25 Nov, 2024 1 commit
- Allow overwrite flashinfer use_tensorcore (#2169) · 8e1adb84
  Lianmin Zheng authored Nov 24, 2024
  
  8e1adb84
24 Nov, 2024 3 commits
- Fix docs (#2164) · 8912b763
  Lianmin Zheng authored Nov 24, 2024
  
  8912b763
- Simplify batch update (#2154) · c211e7b6
  Lianmin Zheng authored Nov 24, 2024
  
  c211e7b6
- Merged three native APIs into one: get_server_info (#2152) · dbe17293
  Henry Hyeonmok Ko authored Nov 24, 2024
  
  dbe17293
22 Nov, 2024 4 commits
- Expose max total num tokens from Runtime & Engine API (#2092) · c35cd1f8
  Henry Hyeonmok Ko authored Nov 22, 2024
  
  c35cd1f8
- feat(pre-commit): trim unnecessary notebook metadata from git history (#2127) · 72f87b72
  Xuehai Pan authored Nov 23, 2024
  
  72f87b72
- chore: bump v0.3.6 (#2120) · 9a00e6f4
  Yineng Zhang authored Nov 22, 2024
  
  9a00e6f4
- Rename sglang.bench_latency to sglang.bench_one_batch (#2118) · dfec7fca
  Lianmin Zheng authored Nov 21, 2024
  
  dfec7fca
18 Nov, 2024 1 commit

add phi-3 small support (#2062) · 8c280cee

Tanjiro authored Nov 17, 2024


Co-authored-by: Tushar Goel <114812108+AI-Tushar@users.noreply.github.com>

8c280cee

15 Nov, 2024 2 commits
- fix small typos in docs (#2047) · 023d0a73
  Xiaoyu Zhang authored Nov 16, 2024
  
  023d0a73
- Release v0.3.5.post2 (#2046) · 32c9a7ec
  Lianmin Zheng authored Nov 15, 2024
  
  32c9a7ec