Commits · 7ef0084b0d2e3b91fe1fa7cd5e396d47aa613797 · change / sglang · GitLab

08 Nov, 2024 11 commits
- Add sentence_transformers to CI dependency (#1958) · 7ef0084b
  Lianmin Zheng authored Nov 08, 2024
  
  7ef0084b
- [Release, ROCm] release ROCm docker build for AMD MI GPUs (#1957) · f9a377f6
  HAI authored Nov 08, 2024
  
  f9a377f6
- Adjust reward model's score module and pooler module order for reducing computation (#1956) · 4ade15dd
  aqweteddy authored Nov 08, 2024
  
  4ade15dd
- Remove the useless to_srt_kwargs (#1955) · 8dc84da0
  Lianmin Zheng authored Nov 07, 2024
  
  8dc84da0
- Gemma2 reward model support (#1954) · f16eb15d
  aqweteddy authored Nov 08, 2024
  
  f16eb15d
- Monitoring documentation (#1933) · 5bc2508b
  Yudi Xue authored Nov 07, 2024
  
  5bc2508b
- Update setup_github_runner.md (#1952) · a71a44f2
  Lianmin Zheng authored Nov 07, 2024
  
  a71a44f2
- Add a timeout for execute-notebook.yml (#1951) · 691808d5
  Lianmin Zheng authored Nov 07, 2024
  
  691808d5
- [ENV, ROCm] update environment settings (#1939) · d32fba2a
  HAI authored Nov 07, 2024
  
  d32fba2a
- [Performance, Triton Kernel Args] extend_attention, optimize kern args to _fwd_kernel (#1941) · 67c424cc
  HAI authored Nov 07, 2024
  
  67c424cc
- [Doc] fix docs (#1949) · 1ae270c5
  Lianmin Zheng authored Nov 07, 2024
  
  1ae270c5
07 Nov, 2024 3 commits
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
- [Docs] fix 404 - Contributor Guide (#1942) · dca87ec3
  HAI authored Nov 07, 2024
  
  dca87ec3
- Add Rust Router Python Binding (#1891) · 4b1d7a25
  Austin Liu authored Nov 07, 2024
```
Signed-off-by: Austin Liu <austin362667@gmail.com>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
```
  4b1d7a25
06 Nov, 2024 3 commits
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
- [rust] refactor server and router (#1922) · 96766101
  Byron Hsu authored Nov 06, 2024
  
  96766101
- support prometheus metrics (#1853) · a146d999
  Lzhang-hub authored Nov 06, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  a146d999
05 Nov, 2024 3 commits
- [Doc] improve relative links and structure (#1924) · f5113e50
  Lianmin Zheng authored Nov 05, 2024
  
  f5113e50
- Change judge to classify & Modify make file (#1920) · 02755768
  Chayenne authored Nov 04, 2024
  
  02755768
- Update CODEOWNERS (#1916) · 463d56bf
  Byron Hsu authored Nov 04, 2024
  
  463d56bf
04 Nov, 2024 3 commits
- [router] Impl radix tree and set up CI (#1893) · 530ff541
  Byron Hsu authored Nov 04, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  530ff541
- [Docs, ROCm] update install to cover ROCm with MI GPUs (#1915) · 3cd28092
  HAI authored Nov 04, 2024
  
  3cd28092
- Add Reward API Docs etc (#1910) · 704f8e8e
  Chayenne authored Nov 03, 2024
```
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
```
  704f8e8e
03 Nov, 2024 13 commits
- Fix regex docs (#1909) · 1853c352
  Lianmin Zheng authored Nov 03, 2024
  
  1853c352
- Release v0.3.5 (#1908) · 65859754
  Lianmin Zheng authored Nov 03, 2024
  
  65859754
- Let reward model take text inputs instead of message lists (#1907) · 2ce32db6
  Lianmin Zheng authored Nov 03, 2024
```
Co-authored-by: Kyle Corbitt <kyle@corbt.com>
```
  2ce32db6
- feat: support truss endpoint for benchmark serving (#1906) · 793b79db
  Yineng Zhang authored Nov 03, 2024
  
  793b79db
- Escape backwards slash (#1902) · 1363b519
  Iñaki Arango authored Nov 03, 2024
  
  1363b519
- Unify the model type checking (#1905) · 0abbf289
  Lianmin Zheng authored Nov 03, 2024
  
  0abbf289
- Simplify tokenizer manager (#1904) · c17c5781
  Lianmin Zheng authored Nov 03, 2024
  
  c17c5781
- Allow passing dtype and max_new_tokens to HF reference script (#1903) · 916b3cdd
  Jani Monoses authored Nov 03, 2024
  
  916b3cdd
- Simplify tokenizer manager (#1899) · 838dcda1
  Lianmin Zheng authored Nov 03, 2024
  
  838dcda1
- Do not use longest prefix matching when #queue-req is large (#1896) · efbc116a
  Lianmin Zheng authored Nov 03, 2024
  
  efbc116a
- turn off log (#1895) · 6aed0445
  Chayenne authored Nov 03, 2024
  
  6aed0445
- Add engine api (#1894) · 908dd7f9
  Chayenne authored Nov 02, 2024
  
  908dd7f9
- Fix ci and link error (#1892) · f4cd8040
  Chayenne authored Nov 02, 2024
```
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
```
  f4cd8040
02 Nov, 2024 4 commits
- Fix docs (#1890) · be7986e0
  Lianmin Zheng authored Nov 02, 2024
  
  be7986e0
- Fix docs ci (#1888) · 5a5f1843
  Chayenne authored Nov 02, 2024
  
  5a5f1843
- Fix docs (#1889) · 7b394e5f
  Lianmin Zheng authored Nov 02, 2024
  
  7b394e5f
- Native api (#1886) · 3b60558d
  Chayenne authored Nov 02, 2024
```
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
```
  3b60558d