Commits · 51c81e339bb50db2cb5fb282498886562883b5f0 · change / sglang

27 Oct, 2024 2 commits
- Add openAI compatible API (#1810) · 51c81e33
  Chayenne authored Oct 27, 2024
```
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
```
  51c81e33
- Update hyperparameter_tuning.md (#1813) · 1be853ee
  Lianmin Zheng authored Oct 26, 2024
  
  1be853ee
26 Oct, 2024 4 commits
- Simplify our docs with complicated functions into utils (#1807) · ced362f7
  Chayenne authored Oct 26, 2024
```
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
```
  ced362f7
- Update links (#1805) · 9084a864
  Lianmin Zheng authored Oct 26, 2024
  
  9084a864
- Update ci workflows (#1804) · 6aa94b96
  Lianmin Zheng authored Oct 26, 2024
  
  6aa94b96
- Add support for ipynb (#1786) · 715b16c1
  Chayenne authored Oct 25, 2024
  
  715b16c1
25 Oct, 2024 2 commits
- Release v0.3.4.post2 (#1796) · 30643fed
  Lianmin Zheng authored Oct 25, 2024
```
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
```
  30643fed
- Fix logprob in the overlapped mode (#1795) · e646c590
  Lianmin Zheng authored Oct 25, 2024
  
  e646c590
23 Oct, 2024 2 commits
- Update docs (#1768) · b7d05594
  Lianmin Zheng authored Oct 23, 2024
```
Co-authored-by: Chayenne Zhao <zhaochenyang20@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  b7d05594
- Fuse more ops & Simplify token mapping (#1758) · ad4125d1
  Lianmin Zheng authored Oct 22, 2024
  
  ad4125d1
15 Oct, 2024 1 commit
- [doc] improve engine doc and add to readme (#1670) · cd0be748
  Byron Hsu authored Oct 14, 2024
  
  cd0be748
13 Oct, 2024 1 commit
- [doc] Add engine section in backend.md (#1656) · c3f2fc5a
  Byron Hsu authored Oct 13, 2024
  
  c3f2fc5a
02 Oct, 2024 1 commit
- [Fix] Fix all the Huggingface paths (#1553) · 2c7d0a5b
  Theresa Barton authored Oct 02, 2024
  
  2c7d0a5b
30 Sep, 2024 1 commit
- Rename InputMetadata -> ForwardBatch (#1543) · 36d5acfc
  Lianmin Zheng authored Sep 30, 2024
  
  36d5acfc
29 Sep, 2024 1 commit
- Improve process creation (#1534) · 04868543
  Lianmin Zheng authored Sep 29, 2024
  
  04868543
28 Sep, 2024 1 commit
- Multiple minor fixes (#1530) · 4e4459b9
  Lianmin Zheng authored Sep 28, 2024
  
  4e4459b9
22 Sep, 2024 2 commits
- [CI, AMD] Add AMD tests to CI (#1491) · 6f3cf129
  Ying Sheng authored Sep 22, 2024
  
  6f3cf129
- Better unit tests for adding a new model (#1488) · 167591e8
  Lianmin Zheng authored Sep 22, 2024
  
  167591e8
21 Sep, 2024 2 commits
- doc: update backend (#1486) · 441c22db
  Yineng Zhang authored Sep 21, 2024
  
  441c22db
- fix incorrect links in documentation (#1481) · ce636ac4
  Ran Chen authored Sep 21, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  ce636ac4
18 Sep, 2024 1 commit
- Fuse top_k and top_k in the sampler (#1457) · 7f24ea95
  Lianmin Zheng authored Sep 18, 2024
  
  7f24ea95
17 Sep, 2024 1 commit
- Enable MLA by default (#1447) · c6b6d2e7
  Ke Bao authored Sep 17, 2024
  
  c6b6d2e7
15 Sep, 2024 3 commits
- Release v0.3.1 (#1430) · e79f6cd7
  Lianmin Zheng authored Sep 15, 2024
  
  e79f6cd7
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097
- Update backend.md (#1429) · 282681b8
  Lianmin Zheng authored Sep 15, 2024
  
  282681b8
11 Sep, 2024 1 commit
- Deprecate --disable-flashinfer and introduce --attention-backend (#1380) · 46094e0c
  Lianmin Zheng authored Sep 10, 2024
  
  46094e0c
10 Sep, 2024 2 commits
- [Docs] Improve documentations (#1368) · 8d1095db
  Lianmin Zheng authored Sep 09, 2024
  
  8d1095db
- Adding Documentation for installation (#1300) · 743007e1
  Chayenne authored Sep 10, 2024
```
Co-authored-by: zhaochen20 <zhaochenyang20@gmail.com>
```
  743007e1
03 Sep, 2024 1 commit
- [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308) · f64eae3a
  Lianmin Zheng authored Sep 02, 2024
  
  f64eae3a
26 Aug, 2024 3 commits
- [FEAT] JSON constrained support (#1125) · 9935f97b
  havetc authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  9935f97b
- Update workflow files (#1214) · d3efcb39
  Lianmin Zheng authored Aug 25, 2024
  
  d3efcb39
- Update CI runner docs (#1213) · 61bb223e
  Lianmin Zheng authored Aug 25, 2024
  
  61bb223e
25 Aug, 2024 1 commit
- [Minor] Improve the function organization in TokenizerManager & improve loggers (#1208) · 90227800
  Lianmin Zheng authored Aug 25, 2024
  
  90227800
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
21 Aug, 2024 1 commit
- Support min-p sampling (#1167) · 068e9eae
  intervitens authored Aug 22, 2024
  
  068e9eae
18 Aug, 2024 1 commit
- Improve benchmark (#1140) · 57d0bd91
  Lianmin Zheng authored Aug 17, 2024
  
  57d0bd91
15 Aug, 2024 1 commit
- update hyperparameter guide (#1114) · 87a0db82
  Lianmin Zheng authored Aug 15, 2024
  
  87a0db82
13 Aug, 2024 1 commit
- Update the mixtral to use the better FusedMoE layer (#1081) · ad3e4f16
  Lianmin Zheng authored Aug 13, 2024
  
  ad3e4f16
12 Aug, 2024 1 commit
- docs: update setup github runner (#1050) · 89f23a51
  Yineng Zhang authored Aug 12, 2024
  
  89f23a51
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80