Commits · bf86c5e990d72df28c3ecb07e4ba3ec838ea6b8e · change / sglang

19 Apr, 2025 1 commit
- restruct compressed_tensors_w8a8_fp8 (#5475) · bf86c5e9
  Xiaoyu Zhang authored Apr 19, 2025
  
  bf86c5e9
17 Apr, 2025 2 commits

Feat/support encoder model (like bert) (#4887) · 3bface15
woodx authored Apr 17, 2025

3bface15

[Model Support] unsloth/Phi-4-mini bnb model (#4982) · 8f783c19

eigen authored Apr 16, 2025


Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

8f783c19

09 Apr, 2025 2 commits
- update grok test (#5171) · 7f875f12
  saienduri authored Apr 09, 2025
  
  7f875f12
- Tiny disable model that does not work (#5175) · 39efad4f
  fzyzcjy authored Apr 09, 2025
  
  39efad4f
31 Mar, 2025 1 commit
- [Fix] Improve Lora tests and reduce CI runtime (#4925) · 42873eac
  Baizhou Zhang authored Mar 30, 2025
  
  42873eac
30 Mar, 2025 1 commit
- Fix retract for page size > 1 (#4914) · 4ede6770
  Lianmin Zheng authored Mar 30, 2025
  
  4ede6770
28 Mar, 2025 2 commits
- [Feature] add multi-rank support for Lora (#4492) · ef9a378a
  chaobo jia authored Mar 29, 2025
```
Co-authored-by: rudy152 <czh1137892874@gmail.com>
```
  ef9a378a
- Fix the lora adapter when lora path is none (#4799) · 9fdc6d6a
  Qiaolin Yu authored Mar 28, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  9fdc6d6a
27 Mar, 2025 1 commit
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
25 Mar, 2025 2 commits
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
- [Model] Support Qwen2ForSequenceClassification (#4609) · 22c3702e
  Ximingwang-09 authored Mar 25, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  22c3702e
19 Mar, 2025 1 commit
- [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) · 588865f0
  aoshen524 authored Mar 18, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  588865f0
13 Mar, 2025 1 commit
- Add a dummy grok test case (#4399) · f0afaf52
  Lianmin Zheng authored Mar 13, 2025
  
  f0afaf52
10 Mar, 2025 1 commit
- Clean up fp8 support (#4230) · e8a69e4d
  Lianmin Zheng authored Mar 09, 2025
  
  e8a69e4d
07 Mar, 2025 1 commit
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8
04 Mar, 2025 1 commit
- Simplify eagle tests and TP sync in grammar backend (#4066) · 77a3954b
  Lianmin Zheng authored Mar 04, 2025
  
  77a3954b
28 Feb, 2025 1 commit
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50
24 Feb, 2025 1 commit
- Fix dependency (#3813) · 27a46317
  Lianmin Zheng authored Feb 24, 2025
  
  27a46317
20 Feb, 2025 1 commit
- [Fix] Fix bugs and refactor codes in lora for better scalability. (#3652) · e79f7420
  aoshen524 authored Feb 20, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  e79f7420
10 Feb, 2025 1 commit
- [Fix] Fix accuracy bug and refactor codes for lora (#3413) · c45cab1c
  Baizhou Zhang authored Feb 09, 2025
  
  c45cab1c
04 Feb, 2025 1 commit
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
21 Jan, 2025 1 commit
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
20 Jan, 2025 1 commit
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
17 Jan, 2025 1 commit
- Add ut for qwen model (#2947) · d47c5101
  Ke Bao authored Jan 18, 2025
  
  d47c5101
11 Dec, 2024 1 commit
- Add support for IBM Granite 3.x models (#2437) · 993956c6
  Fred Reiss authored Dec 11, 2024
  
  993956c6
28 Nov, 2024 1 commit
- Add OLMo2 model. (#2233) · db674e3d
  Jani Monoses authored Nov 28, 2024
  
  db674e3d
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
21 Nov, 2024 1 commit
- Add support for Qwen2-VL-based embedding models (#2055) · f6f71379
  James Xu authored Nov 21, 2024
  
  f6f71379
18 Nov, 2024 1 commit

add phi-3 small support (#2062) · 8c280cee

Tanjiro authored Nov 17, 2024


Co-authored-by: Tushar Goel <114812108+AI-Tushar@users.noreply.github.com>

8c280cee

12 Nov, 2024 1 commit
- fix test_embedding_models prompt length too long's bug (#2015) · eff468dd
  Xiaoyu Zhang authored Nov 12, 2024
  
  eff468dd
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
04 Nov, 2024 1 commit
- Add Reward API Docs etc (#1910) · 704f8e8e
  Chayenne authored Nov 03, 2024
```
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
```
  704f8e8e
03 Nov, 2024 1 commit
- Let reward model take text inputs instead of message lists (#1907) · 2ce32db6
  Lianmin Zheng authored Nov 03, 2024
```
Co-authored-by: Kyle Corbitt <kyle@corbt.com>
```
  2ce32db6
30 Oct, 2024 1 commit
- Add new model: Gpt2 (#1833) · 5e00ddeb
  DanielC12321 authored Oct 29, 2024
  
  5e00ddeb
21 Oct, 2024 2 commits
- Fix sliding window attention and gemma-2 unit tests in CI (#1746) · 00611286
  Lianmin Zheng authored Oct 21, 2024
  
  00611286
- Add GLM-4 TextGeneration Model support for SGLang (#1736) · 45d5af24
  sixgod authored Oct 21, 2024
  
  45d5af24
17 Oct, 2024 2 commits
- Fix failed ci tests on long prompts; Better error messages for embedding models (#1700) · 7feba415
  Lianmin Zheng authored Oct 17, 2024
  
  7feba415
- Fix the failed unit tests (#1699) · 30ee3630
  Lianmin Zheng authored Oct 17, 2024
  
  30ee3630