Commits · 69aa937aa528f0066ab5226bb428cbdf37dec048 · change / sglang

12 Oct, 2024 1 commit
- Fix unit tests and type annotations (#1648) · 69aa937a
  Lianmin Zheng authored Oct 12, 2024
  
  69aa937a
11 Oct, 2024 2 commits
- Release v0.3.3.post1 (#1636) · 00c7e636
  Lianmin Zheng authored Oct 11, 2024
  
  00c7e636
- Add back data parallelism (#1635) · 23cc66f7
  Lianmin Zheng authored Oct 11, 2024
  
  23cc66f7
04 Oct, 2024 1 commit
- [Fix] Fix major performance bug in certain cases (#1563) · 04b262cd
  Ying Sheng authored Oct 04, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  04b262cd
29 Sep, 2024 1 commit
- Improve process creation (#1534) · 04868543
  Lianmin Zheng authored Sep 29, 2024
  
  04868543
28 Sep, 2024 1 commit
- [Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525) · 9aa6553d
  Ying Sheng authored Sep 27, 2024
  
  9aa6553d
24 Sep, 2024 1 commit
- [CI] Move AMD test to a separate file (#1500) · bc068e96
  Lianmin Zheng authored Sep 24, 2024
  
  bc068e96
23 Sep, 2024 1 commit
- minor: add mla fp8 test (#1494) · 42a2d82b
  Yineng Zhang authored Sep 23, 2024
  
  42a2d82b
22 Sep, 2024 2 commits
- [CI, AMD] Add AMD tests to CI (#1491) · 6f3cf129
  Ying Sheng authored Sep 22, 2024
  
  6f3cf129
- Add a unit test for data parallelism (#1489) · 13f1357e
  Lianmin Zheng authored Sep 22, 2024
  
  13f1357e
21 Sep, 2024 2 commits
- Add MLA gsm8k eval (#1484) · b8ccaf4d
  Ke Bao authored Sep 21, 2024
  
  b8ccaf4d
- Fix triton head num (#1482) · a68cb201
  Ke Bao authored Sep 21, 2024
  
  a68cb201
18 Sep, 2024 1 commit
- Fix oom issues with fp8 for llama (#1454) · 1acccb36
  Lianmin Zheng authored Sep 18, 2024
  
  1acccb36
15 Sep, 2024 1 commit
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097
13 Sep, 2024 4 commits
- ci: fix finish (#1414) · f3d32f88
  Yineng Zhang authored Sep 14, 2024
  
  f3d32f88
- Update pr-test.yml (#1412) · 8779da95
  Lianmin Zheng authored Sep 13, 2024
  
  8779da95
- Balance test in CI (#1411) · ad0ff62a
  Lianmin Zheng authored Sep 12, 2024
  
  ad0ff62a
- [CI] Include triton backend and online serving benchmark into CI (#1408) · 68be2f6d
  Lianmin Zheng authored Sep 12, 2024
  
  68be2f6d
03 Sep, 2024 1 commit
- [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308) · f64eae3a
  Lianmin Zheng authored Sep 02, 2024
  
  f64eae3a
02 Sep, 2024 1 commit
- feat: update nightly gsm8k eval (#1304) · 2561ed01
  Yineng Zhang authored Sep 03, 2024
  
  2561ed01
01 Sep, 2024 3 commits
- ci: add nightly eval (#1291) · 6487ef64
  Yineng Zhang authored Sep 02, 2024
  
  6487ef64
- [CI] merge all ci tests into one file (#1289) · 761b2ceb
  Lianmin Zheng authored Sep 01, 2024
  
  761b2ceb
- [CI] Add more multi-gpu tests (#1280) · 1b5d56f7
  Lianmin Zheng authored Sep 01, 2024
  
  1b5d56f7
28 Aug, 2024 3 commits
- Add sglang.bench_latency to CI (#1243) · 6c498313
  Lianmin Zheng authored Aug 28, 2024
  
  6c498313
- hotfix: revert sampler CUDA Graph (#1242) · f25f4dfd
  Yineng Zhang authored Aug 28, 2024
  
  f25f4dfd
- Fix bench latency benchmark (#1225) · 1ece2cda
  Liangsheng Yin authored Aug 28, 2024
  
  1ece2cda
26 Aug, 2024 4 commits
- [CI] Parallelize unit tests in CI (#1219) · 97589a60
  Mingyi authored Aug 25, 2024
  
  97589a60
- minor: improve CI and dependencies (#1212) · 632d506d
  Liangsheng Yin authored Aug 25, 2024
  
  632d506d
- Update workflow files (#1214) · d3efcb39
  Lianmin Zheng authored Aug 25, 2024
  
  d3efcb39
- Update CI runner docs (#1213) · 61bb223e
  Lianmin Zheng authored Aug 25, 2024
  
  61bb223e
25 Aug, 2024 2 commits
- Update CI workflows (#1210) · 15f1a49d
  Lianmin Zheng authored Aug 25, 2024
  
  15f1a49d
- Support Alibaba-NLP/gte-Qwen2-7B-instruct embedding Model (#1186) · 30b4f771
  Chayenne authored Aug 26, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  30b4f771
17 Aug, 2024 1 commit
- Fix CI accuracy && time out limit (#1133) · 5d0d40d0
  Liangsheng Yin authored Aug 16, 2024
  
  5d0d40d0
15 Aug, 2024 2 commits
- ci: compatible with fork repo (#1115) · 26e9c12c
  Yineng Zhang authored Aug 16, 2024
  
  26e9c12c
- Enable chunked prefill by default (#1040) · e86b1ccb
  Lianmin Zheng authored Aug 14, 2024
  
  e86b1ccb
14 Aug, 2024 2 commits
- ci: remove workflow path trigger (#1096) · f14569f6
  Yineng Zhang authored Aug 14, 2024
  
  f14569f6
- ci: update timeout and retry (#1086) · c8423ca3
  Yineng Zhang authored Aug 14, 2024
```
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  c8423ca3
13 Aug, 2024 3 commits
- ci: add accuracy timeout (#1078) · cebd78d8
  Yineng Zhang authored Aug 13, 2024
  
  cebd78d8
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
- ci: add cancel pr workflow (#1070) · 396a13e6
  Yineng Zhang authored Aug 13, 2024
  
  396a13e6