Commits · 2d346a57c2fb753d9353f346dff3bbc5b208bd0b · change / sglang

19 Sep, 2024 1 commit
- Fix padding in the cuda graph (#1469) · 2d346a57
  Lianmin Zheng authored Sep 19, 2024
  
  2d346a57
18 Sep, 2024 1 commit
- [Event] Add public meeting invite to README (#1458) · 8f527e29
  Ying Sheng authored Sep 18, 2024
  
  8f527e29
17 Sep, 2024 2 commits
- Enable MLA by default (#1447) · c6b6d2e7
  Ke Bao authored Sep 17, 2024
  
  c6b6d2e7
- Release 0.3.1.post1 (#1445) · 90a26be3
  Lianmin Zheng authored Sep 17, 2024
  
  90a26be3
15 Sep, 2024 1 commit
- Release v0.3.1 (#1430) · e79f6cd7
  Lianmin Zheng authored Sep 15, 2024
  
  e79f6cd7
14 Sep, 2024 1 commit
- Enable torch.compile for triton backend (#1422) · 9463bc13
  Lianmin Zheng authored Sep 14, 2024
  
  9463bc13
12 Sep, 2024 2 commits
- Add Support for XVERSE Models (Dense and MoE) to sglang (#1397) · c33d82a2
  hxer7963 authored Sep 12, 2024
```
Co-authored-by: will he <hexin@xverse.cn>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  c33d82a2
- Fix README format (#1399) · 2a71be5e
  William authored Sep 12, 2024
  
  2a71be5e
11 Sep, 2024 2 commits
- BaiChuan2 Model (#1367) · 224200e3
  Vectory authored Sep 11, 2024
```
Co-authored-by: wanpenghan <wanpenghan@sohu-inc.com>
```
  224200e3
- Deprecate --disable-flashinfer and introduce --attention-backend (#1380) · 46094e0c
  Lianmin Zheng authored Sep 10, 2024
  
  46094e0c
10 Sep, 2024 2 commits
- Support MiniCPM3 (#1371) · e72275cf
  William authored Sep 10, 2024
  
  e72275cf
- [Docs] Improve documentations (#1368) · 8d1095db
  Lianmin Zheng authored Sep 09, 2024
  
  8d1095db
04 Sep, 2024 1 commit
- [Doc] update news (#1327) · 5ab9418f
  Yineng Zhang authored Sep 04, 2024
  
  5ab9418f
03 Sep, 2024 3 commits
- chore: bump v0.3.0 (#1320) · a63c8275
  Yineng Zhang authored Sep 04, 2024
  
  a63c8275
- Update README.md for llava-onevision instructions (#1313) · c500f96b
  Lianmin Zheng authored Sep 03, 2024
  
  c500f96b
- [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308) · f64eae3a
  Lianmin Zheng authored Sep 02, 2024
  
  f64eae3a
02 Sep, 2024 1 commit
- Release v0.2.15 (#1295) · 99994427
  Lianmin Zheng authored Sep 01, 2024
  
  99994427
01 Sep, 2024 2 commits
- [doc] Fix more broken links (#1294) · 4a9f8ea4
  Byron Hsu authored Sep 01, 2024
  
  4a9f8ea4
- [doc] fix quick start link (#1282) · 6cc9c525
  Byron Hsu authored Aug 31, 2024
  
  6cc9c525
30 Aug, 2024 2 commits
- Report median instead of mean in bench_latency.py (#1269) · 79ece2c5
  Lianmin Zheng authored Aug 30, 2024
  
  79ece2c5
- Update README.md - Supported Models add Exaone 3.0 (#1267) · 55f5976b
  김종곤 authored Aug 30, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  55f5976b
28 Aug, 2024 6 commits
- chore: bump v0.2.14.post2 (#1250) · 13ac95b8
  Yineng Zhang authored Aug 29, 2024
  
  13ac95b8
- [Fix] Fix llava on multi images (#1247) · bf53bf51
  Lianmin Zheng authored Aug 28, 2024
  
  bf53bf51
- hotfix: revert sampler CUDA Graph (#1242) · f25f4dfd
  Yineng Zhang authored Aug 28, 2024
  
  f25f4dfd
- Update README.md (#1239) · 184ae1c6
  Lianmin Zheng authored Aug 28, 2024
  
  184ae1c6
- feat: support sm75 with FlashInfer v0.1.6 (#1233) · 198974cd
  Yineng Zhang authored Aug 28, 2024
  
  198974cd
- Fix readme (#1236) · c8a9e791
  Dr. Artificial曾小健 authored Aug 28, 2024
  
  c8a9e791
26 Aug, 2024 1 commit
- chore: bump v0.2.14 (#1155) · c5fe11a8
  Yineng Zhang authored Aug 27, 2024
  
  c5fe11a8
25 Aug, 2024 1 commit
- Support Alibaba-NLP/gte-Qwen2-7B-instruct embedding Model (#1186) · 30b4f771
  Chayenne authored Aug 26, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  30b4f771
24 Aug, 2024 2 commits
- Update README.md (#1198) · b20daf98
  Lianmin Zheng authored Aug 24, 2024
  
  b20daf98
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
23 Aug, 2024 1 commit

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2... · a5b14ad0

Kaichen Zhang - NTU authored Aug 24, 2024


[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)
Co-authored-by: Bo Li <drluodian@gmail.com>

a5b14ad0

21 Aug, 2024 1 commit
- [Docs] Fix rendering of details in README (#1179) · ac1b74fa
  Zhanghao Wu authored Aug 21, 2024
  
  ac1b74fa
20 Aug, 2024 2 commits
- fix: resolve README render (#1166) · 350a8160
  Yineng Zhang authored Aug 21, 2024
  
  350a8160
- Improve docs and warnings (#1164) · a8ae6403
  Lianmin Zheng authored Aug 20, 2024
  
  a8ae6403
19 Aug, 2024 1 commit
- [Docs] Add instruction for running on clouds and kubernetes with SkyPilot (#1144) · d8627ed1
  Zhanghao Wu authored Aug 18, 2024
```
Co-authored-by: Zongheng Yang <zongheng.y@gmail.com>
```
  d8627ed1
15 Aug, 2024 1 commit
- chore: bump v0.2.13 (#1111) · 5bd95374
  Yineng Zhang authored Aug 16, 2024
  
  5bd95374
14 Aug, 2024 1 commit
- docs: update README (#1098) · fe502432
  Yineng Zhang authored Aug 14, 2024
  
  fe502432
13 Aug, 2024 1 commit
- Example file for docker compose and k8s (#1006) · 312e8492
  Lucien authored Aug 14, 2024
  
  312e8492
12 Aug, 2024 1 commit
- chore: bump v0.2.12 (#1048) · b0ad0c1b
  Yineng Zhang authored Aug 12, 2024
  
  b0ad0c1b