Commits · e074e76b31d4fff13e87a455dbc3acdaa92c537a · change / sglang

21 Feb, 2025 1 commit
- docs: Add offline engine launch example and documentation (#3771) · e074e76b
  Shi Shuai authored Feb 21, 2025
  
  e074e76b
14 Feb, 2025 1 commit
- [fix] added support for vlm in offline inference (#3548) · fb4c9c3a
  Shenggui Li authored Feb 15, 2025
  
  fb4c9c3a
03 Feb, 2025 1 commit

Yineng Zhang authored Feb 03, 2025


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>

013021b6

20 Jan, 2025 2 commits
- Improve metrics, logging, and importing orders (#2992) · cd493b5a
  Lianmin Zheng authored Jan 19, 2025
  
  cd493b5a
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
02 Jan, 2025 1 commit

Eagle speculative decoding part 4: Add EAGLE2 worker (#2150) · 815dce05

yukavio authored Jan 02, 2025


Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

815dce05

06 Dec, 2024 1 commit
- Add more support for intel Gaudi accelerators (#2357) · 37ee906f
  Qun Yang authored Dec 06, 2024
  
  37ee906f
11 Nov, 2024 1 commit
- Add Engine::encode example (#2000) · 9d427265
  James Xu authored Nov 11, 2024
  
  9d427265
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
05 Nov, 2024 1 commit
- Change judge to classify & Modify make file (#1920) · 02755768
  Chayenne authored Nov 04, 2024
  
  02755768
27 Oct, 2024 1 commit
- Support token ids in `engine.generate` (#1820) · 6fcd6d7d
  Byron Hsu authored Oct 27, 2024
  
  6fcd6d7d
11 Oct, 2024 1 commit
- [engine] support async and streaming (#1614) · 862cd265
  Byron Hsu authored Oct 11, 2024
  
  862cd265
07 Oct, 2024 1 commit
- Provide an offline engine API (#1567) · 551a3a9d
  Byron Hsu authored Oct 06, 2024
  
  551a3a9d
02 Oct, 2024 1 commit
- [Fix] Fix all the Huggingface paths (#1553) · 2c7d0a5b
  Theresa Barton authored Oct 02, 2024
  
  2c7d0a5b
30 Sep, 2024 1 commit
- [Fix, LoRA] fix LoRA with updates in main (#1545) · 0f4fb19b
  Ying Sheng authored Sep 30, 2024
  
  0f4fb19b
28 Sep, 2024 2 commits
- Multiple minor fixes (#1530) · 4e4459b9
  Lianmin Zheng authored Sep 28, 2024
  
  4e4459b9
- [Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525) · 9aa6553d
  Ying Sheng authored Sep 27, 2024
  
  9aa6553d
22 Sep, 2024 1 commit
- [API, Feature] Support response prefill for openai API (#1490) · e4780cf8
  Ying Sheng authored Sep 22, 2024
  
  e4780cf8
19 Sep, 2024 1 commit
- fix: creat new dict everytime for putting new frame (#1464) · 446ea332
  Li Bo authored Sep 19, 2024
  
  446ea332
15 Sep, 2024 1 commit
- [Feature] Support LoRA path renaming and add LoRA serving benchmarks (#1433) · 37963394
  Ying Sheng authored Sep 15, 2024
  
  37963394
09 Sep, 2024 1 commit
- [Feat] Add modalities for vision server when handling pixel values for llava (#1346) · 662ecd93
  Kaichen Zhang - NTU authored Sep 09, 2024
  
  662ecd93
28 Aug, 2024 1 commit
- [Fix] Fix OOM in llava base class (#1249) · 0a97d796
  Lianmin Zheng authored Aug 28, 2024
  
  0a97d796
25 Aug, 2024 1 commit
- [Fix] Fixing the multi-images error for llava-onevision (#1205) · 66e7dcaf
  Kaichen Zhang - NTU authored Aug 26, 2024
  
  66e7dcaf
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65