Commits · ec1c21cdc4d9dcfc94f48b0dad182dc34b943553 · change / sglang

"...lm-evaluation-harness.git" did not exist on "c3aaad59845b82b742ee9452120c9fc84e3f4ff4"

20 Jan, 2025 1 commit
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
17 Jan, 2025 1 commit
- Add ut for qwen model (#2947) · d47c5101
  Ke Bao authored Jan 18, 2025
  
  d47c5101
11 Dec, 2024 1 commit
- Add support for IBM Granite 3.x models (#2437) · 993956c6
  Fred Reiss authored Dec 11, 2024
  
  993956c6
28 Nov, 2024 1 commit
- Add OLMo2 model. (#2233) · db674e3d
  Jani Monoses authored Nov 28, 2024
  
  db674e3d
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
21 Nov, 2024 1 commit
- Add support for Qwen2-VL-based embedding models (#2055) · f6f71379
  James Xu authored Nov 21, 2024
  
  f6f71379
18 Nov, 2024 1 commit

add phi-3 small support (#2062) · 8c280cee

Tanjiro authored Nov 17, 2024


Co-authored-by: Tushar Goel <114812108+AI-Tushar@users.noreply.github.com>

8c280cee

12 Nov, 2024 1 commit
- fix test_embedding_models prompt length too long's bug (#2015) · eff468dd
  Xiaoyu Zhang authored Nov 12, 2024
  
  eff468dd
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
04 Nov, 2024 1 commit
- Add Reward API Docs etc (#1910) · 704f8e8e
  Chayenne authored Nov 03, 2024
```
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
```
  704f8e8e
03 Nov, 2024 1 commit
- Let reward model take text inputs instead of message lists (#1907) · 2ce32db6
  Lianmin Zheng authored Nov 03, 2024
```
Co-authored-by: Kyle Corbitt <kyle@corbt.com>
```
  2ce32db6
30 Oct, 2024 1 commit
- Add new model: Gpt2 (#1833) · 5e00ddeb
  DanielC12321 authored Oct 29, 2024
  
  5e00ddeb
21 Oct, 2024 2 commits
- Fix sliding window attention and gemma-2 unit tests in CI (#1746) · 00611286
  Lianmin Zheng authored Oct 21, 2024
  
  00611286
- Add GLM-4 TextGeneration Model support for SGLang (#1736) · 45d5af24
  sixgod authored Oct 21, 2024
  
  45d5af24
17 Oct, 2024 2 commits
- Fix failed ci tests on long prompts; Better error messages for embedding models (#1700) · 7feba415
  Lianmin Zheng authored Oct 17, 2024
  
  7feba415
- Fix the failed unit tests (#1699) · 30ee3630
  Lianmin Zheng authored Oct 17, 2024
  
  30ee3630
16 Oct, 2024 1 commit
- Add OLMo model (#1676) · a5114b6f
  Jani Monoses authored Oct 16, 2024
  
  a5114b6f
11 Oct, 2024 1 commit
- Fix the correctness test in bench_latency.py when tp > 1 and test_generation_models.py (#1631) · aba9eae4
  Lianmin Zheng authored Oct 11, 2024
  
  aba9eae4
03 Oct, 2024 1 commit

[Fix] Fix AttributeError in Qwen2.5 LoRA: 'Qwen2ForCausalLM' object has no... · e6852b0d

Minsang Song authored Oct 03, 2024


[Fix] Fix AttributeError in Qwen2.5 LoRA: 'Qwen2ForCausalLM' object has no attribute 'get_hidden_dim' (#1536)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>

e6852b0d

02 Oct, 2024 1 commit
- [Fix] Fix all the Huggingface paths (#1553) · 2c7d0a5b
  Theresa Barton authored Oct 02, 2024
  
  2c7d0a5b
30 Sep, 2024 2 commits
- [Fix, LoRA] fix LoRA with updates in main (#1545) · 0f4fb19b
  Ying Sheng authored Sep 30, 2024
  
  0f4fb19b
- Let ModelRunner take InputMetadata as input, instead of ScheduleBatch (#1541) · 3f0fe08d
  Lianmin Zheng authored Sep 29, 2024
  
  3f0fe08d
28 Sep, 2024 1 commit
- [Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525) · 9aa6553d
  Ying Sheng authored Sep 27, 2024
  
  9aa6553d
25 Sep, 2024 2 commits
- Add support for tie_word_embeddings when loading weights + support for SmolLM (#1508) · 3c93187c
  TianyiQ authored Sep 24, 2024
  
  3c93187c
- [Fix] Fix clean_up_tokenization_spaces in tokenizer (#1510) · fb2d0680
  Lianmin Zheng authored Sep 24, 2024
  
  fb2d0680
22 Sep, 2024 1 commit
- Better unit tests for adding a new model (#1488) · 167591e8
  Lianmin Zheng authored Sep 22, 2024
  
  167591e8
12 Sep, 2024 1 commit
- [Feature] Initial support for multi-LoRA serving (#1307) · 71221692
  Ying Sheng authored Sep 12, 2024
  
  71221692
09 Sep, 2024 1 commit
- [CI] Return output logprobs in unit test (#1361) · 689ff588
  Ying Sheng authored Sep 09, 2024
  
  689ff588
28 Aug, 2024 2 commits
- feat: replace GeluAndMul (#1234) · c411f32e
  Yineng Zhang authored Aug 29, 2024
  
  c411f32e
- fix: increase max_new_tokens when testing generation models (#1244) · 66975360
  Yineng Zhang authored Aug 28, 2024
  
  66975360
26 Aug, 2024 1 commit
- [CI] Fix CI (#1217) · 7514b9f8
  Mingyi authored Aug 25, 2024
  
  7514b9f8
25 Aug, 2024 3 commits
- [CI] Fix the issue of unit test hanging (#1211) · 308d0240
  Ying Sheng authored Aug 25, 2024
  
  308d0240
- Support Alibaba-NLP/gte-Qwen2-7B-instruct embedding Model (#1186) · 30b4f771
  Chayenne authored Aug 26, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  30b4f771
- [Fix] the issue of random order when input is a list (#1199) · 1cb4da5c
  Ying Sheng authored Aug 24, 2024
  
  1cb4da5c
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
14 Aug, 2024 1 commit
- [Feat] Add window attention for gemma-2 (#1056) · 0909bb0d
  Ying Sheng authored Aug 13, 2024
  
  0909bb0d
12 Aug, 2024 1 commit
- fix: Fix returned prefill logits and add output str test (#1046) · 32f61443
  Ying Sheng authored Aug 11, 2024
  
  32f61443
10 Aug, 2024 1 commit
- fix: force max new tokens to be 1 for embedding request (#1019) · b68c4c07
  Ying Sheng authored Aug 10, 2024
  
  b68c4c07
08 Aug, 2024 1 commit
- Add e5-mistral embedding model - step 3/3 (#988) · e040a245
  Ying Sheng authored Aug 08, 2024
  
  e040a245