Commits · 287d07a669d3fd0b0650959b0e35c8e886513824 · change / sglang

21 Jan, 2025 1 commit
- Misc fixes for eagle (flush_cache, CPU overhead) (#3014) · 287d07a6
  Lianmin Zheng authored Jan 20, 2025
  
  287d07a6
20 Jan, 2025 1 commit
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
19 Nov, 2024 1 commit
- Simplify logits penalizer (#2086) · b1104538
  Lianmin Zheng authored Nov 18, 2024
  
  b1104538
06 Oct, 2024 1 commit
- Support min_tokens in sgl.gen (#1573) · 2422de51
  Byron Hsu authored Oct 05, 2024
  
  2422de51
24 Sep, 2024 1 commit
- Update test_srt_backend.py (#1502) · 28b4d8e1
  Lianmin Zheng authored Sep 24, 2024
  
  28b4d8e1
03 Sep, 2024 1 commit
- [Fix] Fix select by ensuring each request has at least one token (#1318) · 1e495e08
  Lianmin Zheng authored Sep 03, 2024
  
  1e495e08
14 Aug, 2024 1 commit
- Use `dtype` to control generate (#1082) · a34dd86a
  Liangsheng Yin authored Aug 14, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  a34dd86a
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
02 Aug, 2024 1 commit
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
01 Aug, 2024 3 commits
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
- Fix unit tests for the frontend language part (#872) · 6f221d4c
  Ying Sheng authored Aug 01, 2024
  
  6f221d4c
- Add OpenAI backend to the CI test (#869) · 40756776
  Ying Sheng authored Aug 01, 2024
  
  40756776
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
11 Feb, 2024 1 commit
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
09 Jan, 2024 1 commit
- Add SRT json decode example (#2) · 331848de
  Liangsheng Yin authored Jan 10, 2024
  
  331848de
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081