Commits · 027e65248f26845057ed6eef663f33bbcd2602f7 · change / sglang · GitLab

12 Nov, 2024 5 commits
- support echo=true and logprobs in openai api when logprobs=1 in lm-evaluation-harness (#1998) · 027e6524
  Xiaoyu Zhang authored Nov 12, 2024
  
  027e6524
- Filter empty prompt in random bench serving (#2011) · b808a383
  Ke Bao authored Nov 12, 2024
  
  b808a383
- remove sglang folder in rust (#2010) · 602ebc66
  Byron Hsu authored Nov 11, 2024
  
  602ebc66
- Fix weight loading for tied word embedding when TP > 1 (#2009) · 530ae1bd
  Lianmin Zheng authored Nov 11, 2024
  
  530ae1bd
- Fix a typo in io_struct.py (#2008) · befc6beb
  Lianmin Zheng authored Nov 11, 2024
  
  befc6beb
11 Nov, 2024 14 commits
- [Minor] Remove unused imports (#2006) · 59a5ba9b
  Lianmin Zheng authored Nov 11, 2024
  
  59a5ba9b
- fix sglang_router not found (#2005) · 86c37d01
  Byron Hsu authored Nov 11, 2024
  
  86c37d01
- support internlm2-reward (#1994) · f18b9c72
  RangiLyu authored Nov 12, 2024
  
  f18b9c72
- run rust test on ubuntu instead of 1-gpu-runner (#2003) · 3e335743
  Byron Hsu authored Nov 11, 2024
  
  3e335743
- Bump router to 0.0.3 (#2004) · 0d94f1dd
  Byron Hsu authored Nov 11, 2024
  
  0d94f1dd
- release router from py38 to py312 (#2002) · e728258d
  Byron Hsu authored Nov 11, 2024
  
  e728258d
- Fix rust unit test and pypi token (#2001) · 239eafbd
  Byron Hsu authored Nov 11, 2024
  
  239eafbd
- Add Engine::encode example (#2000) · 9d427265
  James Xu authored Nov 11, 2024
  
  9d427265
- setup router python binding ci (#1999) · 00ffde20
  Byron Hsu authored Nov 11, 2024
  
  00ffde20
- Add engine encode (#1995) · ddeb9d42
  James Xu authored Nov 11, 2024
```
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  ddeb9d42
- docs: add slides link in README (#1997) · aaf0a315
  Yineng Zhang authored Nov 11, 2024
  
  aaf0a315
- [rust] cache-aware DP - approx tree (#1934) · f9633fa9
  Byron Hsu authored Nov 10, 2024
  
  f9633fa9
- [Performance, Triton] Optimize over mask compute to tl.load in fused_moe_kernel (#1980) · 087ab832
  HAI authored Nov 10, 2024
  
  087ab832
- Add gen-shared-prefix dataset in bench_serving (#1990) · 8169c6f4
  Byron Hsu authored Nov 10, 2024
  
  8169c6f4
10 Nov, 2024 7 commits
- [CI] Balance unit tests (#1988) · 3d043319
  Lianmin Zheng authored Nov 10, 2024
  
  3d043319
- qwen2vl fix bug for #1971 #1897 (#1984) · a8aad935
  yizhang2077 authored Nov 11, 2024
  
  a8aad935
- docs: add shm size for docker run (#1986) · 47ffe7af
  Yineng Zhang authored Nov 10, 2024
  
  47ffe7af
- fix: update pyzmq version (#1983) · b3523af8
  Yineng Zhang authored Nov 10, 2024
  
  b3523af8
- Simplify prometheus metrics (#1981) · 1929c067
  Lianmin Zheng authored Nov 10, 2024
```
Co-authored-by: Mohit Reddy <mohitreddy1996@users.noreply.github.com>
```
  1929c067
- Specify `zmq` Version Requirement (#1982) · ed53ac84
  Huanzhi (Hans) Mao authored Nov 10, 2024
  
  ed53ac84
- [CI] balance unit tests (#1977) · 520f0094
  Lianmin Zheng authored Nov 09, 2024
  
  520f0094
09 Nov, 2024 8 commits
- Clean up metrics code (#1972) · 9c939a3d
  Lianmin Zheng authored Nov 09, 2024
  
  9c939a3d
- [Minor] Fix a typo in test_torchao.py (#1976) · 549e8b83
  Lianmin Zheng authored Nov 09, 2024
  
  549e8b83
- Update pr-test-rust.yml to add a "finish" step (#1975) · a1f32867
  Lianmin Zheng authored Nov 09, 2024
  
  a1f32867
- Update README.md (#1974) · 760552e0
  Lianmin Zheng authored Nov 09, 2024
  
  760552e0
- Introducing SGLang Guru on Gurubase.io (#1745) · d9aada9d
  Kursat Aktas authored Nov 09, 2024
  
  d9aada9d
- Initialize model_worker_batch variable (#1973) · f11eb90f
  Enrique Shockwave authored Nov 09, 2024
  
  f11eb90f
- Fix metrics (#1963) · 95a4ed12
  Yudi Xue authored Nov 08, 2024
  
  95a4ed12
- Updated Instructions on Profiling SGLang Infer System with AMD GPUs (#1966) · d1150e9a
  leishaoSC authored Nov 08, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  d1150e9a
08 Nov, 2024 6 commits
- Update README.md's Slack invitation link (#1962) · e3126e3c
  Chayenne authored Nov 08, 2024
  
  e3126e3c
- [minor] Improve code style and compatibility (#1961) · a5095520
  Lianmin Zheng authored Nov 08, 2024
  
  a5095520
- Add sentence_transformers to CI dependency (#1958) · 7ef0084b
  Lianmin Zheng authored Nov 08, 2024
  
  7ef0084b
- [Release, ROCm] release ROCm docker build for AMD MI GPUs (#1957) · f9a377f6
  HAI authored Nov 08, 2024
  
  f9a377f6
- Adjust reward model's score module and pooler module order for reducing computation (#1956) · 4ade15dd
  aqweteddy authored Nov 08, 2024
  
  4ade15dd
- Remove the useless to_srt_kwargs (#1955) · 8dc84da0
  Lianmin Zheng authored Nov 07, 2024
  
  8dc84da0