Commits · 1ce4878d311a1810fbe6061d1ccb7cd920e74283 · change / sglang

14 Mar, 2025 1 commit
- feat(remote_model): support variable remote backend for model loader (#3964) · 1ce4878d
  wangyu authored Mar 14, 2025
```
Signed-off-by: wangyu <wangyu.steph@bytedance.com>
```
  1ce4878d
13 Mar, 2025 3 commits
- Fix the output of hidden states after HTTP requests (#4269) · 85d2365d
  Qiaolin Yu authored Mar 13, 2025
  
  85d2365d
- Update grafana.json (#4374) · cf721fde
  yuhui authored Mar 13, 2025
  
  cf721fde
- example: add async offline inference demo (#3961) · 959a3143
  Chitsing KUI authored Mar 13, 2025
```
Signed-off-by: joeshikui <joeshikui@tencent.com>
Co-authored-by: joeshikui <joeshikui@tencent.com>
```
  959a3143
10 Mar, 2025 1 commit
- Added example for multimodal embedding (#4206) · 007f8b3d
  simveit authored Mar 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  007f8b3d
05 Mar, 2025 3 commits
- Add examples for server token-in-token-out (#4103) · 357671e2
  Qiaolin Yu authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  357671e2
- example: add vlm to token in & out example (#3941) · 583d6af7
  Mick authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  583d6af7
- Add examples for returning hidden states when using the server (#4074) · 4725e3f6
  Qiaolin Yu authored Mar 04, 2025
  
  4725e3f6
04 Mar, 2025 1 commit
- Remove grafana dashboard's datasource uid (#4051) · 2415ec38
  Kebe authored Mar 04, 2025
  
  2415ec38
03 Mar, 2025 3 commits
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Update metrics documentation (#3264) · a7000a76
  Yudi Xue authored Mar 03, 2025
  
  a7000a76
- Add examples to token-in-token-out for LLM (#4010) · 728e175f
  Chayenne authored Mar 02, 2025
  
  728e175f
02 Mar, 2025 1 commit
- Refactor: Move return_hidden_states to the generate input (#3985) · 40782f05
  Qiaolin Yu authored Mar 01, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
```
  40782f05
28 Feb, 2025 2 commits
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50
- [feat] Add Vertex AI compatible prediction route for /generate (#3866) · bc20e93f
  KCFindstr authored Feb 27, 2025
  
  bc20e93f
27 Feb, 2025 1 commit

Add return hidden state in the native API (#3897) · d6898dd2

Qiaolin Yu authored Feb 27, 2025


Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>

d6898dd2

26 Feb, 2025 1 commit
- Docs: Implemented frontend docs (#3791) · acd1a159
  simveit authored Feb 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  acd1a159
21 Feb, 2025 1 commit
- docs: Add offline engine launch example and documentation (#3771) · e074e76b
  Shi Shuai authored Feb 21, 2025
  
  e074e76b
14 Feb, 2025 2 commits
- [fix] added support for vlm in offline inference (#3548) · fb4c9c3a
  Shenggui Li authored Feb 15, 2025
  
  fb4c9c3a
- Add support for OpenAI API o1 model (#3363) · 6cc30955
  Chuyue Sun authored Feb 13, 2025
```
Co-authored-by: Shan Yu <shanyu1@g.ucla.edu>
```
  6cc30955
03 Feb, 2025 1 commit

refactor EAGLE 2 (#3269) · 013021b6

Yineng Zhang authored Feb 03, 2025


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>

013021b6

20 Jan, 2025 2 commits
- Improve metrics, logging, and importing orders (#2992) · cd493b5a
  Lianmin Zheng authored Jan 19, 2025
  
  cd493b5a
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
02 Jan, 2025 1 commit

Eagle speculative decoding part 4: Add EAGLE2 worker (#2150) · 815dce05

yukavio authored Jan 02, 2025


Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

815dce05

06 Dec, 2024 1 commit
- Add more support for intel Gaudi accelerators (#2357) · 37ee906f
  Qun Yang authored Dec 06, 2024
  
  37ee906f
04 Dec, 2024 1 commit
- Add Docs For SGLang Native Router (#2308) · 18ea841f
  Chayenne authored Dec 04, 2024
  
  18ea841f
22 Nov, 2024 1 commit
- feat(pre-commit): trim unnecessary notebook metadata from git history (#2127) · 72f87b72
  Xuehai Pan authored Nov 23, 2024
  
  72f87b72
11 Nov, 2024 1 commit
- Add Engine::encode example (#2000) · 9d427265
  James Xu authored Nov 11, 2024
  
  9d427265
08 Nov, 2024 1 commit
- Monitoring documentation (#1933) · 5bc2508b
  Yudi Xue authored Nov 07, 2024
  
  5bc2508b
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
05 Nov, 2024 1 commit
- Change judge to classify & Modify make file (#1920) · 02755768
  Chayenne authored Nov 04, 2024
  
  02755768
03 Nov, 2024 1 commit
- Unify the model type checking (#1905) · 0abbf289
  Lianmin Zheng authored Nov 03, 2024
  
  0abbf289
27 Oct, 2024 1 commit
- Support token ids in `engine.generate` (#1820) · 6fcd6d7d
  Byron Hsu authored Oct 27, 2024
  
  6fcd6d7d
20 Oct, 2024 1 commit
- Update vllm to 0.6.3 (#1711) (#1720) · 8bee20f8
  Yineng Zhang authored Oct 19, 2024
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  8bee20f8
11 Oct, 2024 1 commit
- [engine] support async and streaming (#1614) · 862cd265
  Byron Hsu authored Oct 11, 2024
  
  862cd265
07 Oct, 2024 1 commit
- Provide an offline engine API (#1567) · 551a3a9d
  Byron Hsu authored Oct 06, 2024
  
  551a3a9d
06 Oct, 2024 1 commit
- Support min_tokens in sgl.gen (#1573) · 2422de51
  Byron Hsu authored Oct 05, 2024
  
  2422de51
04 Oct, 2024 2 commits
- [Minifix] Remove extra space in cot example (#1569) · 2432ad40
  FredericOdermatt authored Oct 04, 2024
  
  2432ad40
- Use ipc instead of tcp in zmq (#1566) · 114bbc86
  Lianmin Zheng authored Oct 04, 2024
  
  114bbc86