Commits · 3e33574374c0228ca223739842654cca5e0e4851 · change / sglang

"lmdeploy/pytorch/__init__.py" did not exist on "76ae86279a380a653915838d76c5f99f6be26e0c"

11 Nov, 2024 11 commits
- run rust test on ubuntu instead of 1-gpu-runner (#2003) · 3e335743
  Byron Hsu authored Nov 11, 2024
  
  3e335743
- Bump router to 0.0.3 (#2004) · 0d94f1dd
  Byron Hsu authored Nov 11, 2024
  
  0d94f1dd
- release router from py38 to py312 (#2002) · e728258d
  Byron Hsu authored Nov 11, 2024
  
  e728258d
- Fix rust unit test and pypi token (#2001) · 239eafbd
  Byron Hsu authored Nov 11, 2024
  
  239eafbd
- Add Engine::encode example (#2000) · 9d427265
  James Xu authored Nov 11, 2024
  
  9d427265
- setup router python binding ci (#1999) · 00ffde20
  Byron Hsu authored Nov 11, 2024
  
  00ffde20
- Add engine encode (#1995) · ddeb9d42
  James Xu authored Nov 11, 2024
```
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  ddeb9d42
- docs: add slides link in README (#1997) · aaf0a315
  Yineng Zhang authored Nov 11, 2024
  
  aaf0a315
- [rust] cache-aware DP - approx tree (#1934) · f9633fa9
  Byron Hsu authored Nov 10, 2024
  
  f9633fa9
- [Performance, Triton] Optimize over mask compute to tl.load in fused_moe_kernel (#1980) · 087ab832
  HAI authored Nov 10, 2024
  
  087ab832
- Add gen-shared-prefix dataset in bench_serving (#1990) · 8169c6f4
  Byron Hsu authored Nov 10, 2024
  
  8169c6f4
10 Nov, 2024 7 commits
- [CI] Balance unit tests (#1988) · 3d043319
  Lianmin Zheng authored Nov 10, 2024
  
  3d043319
- qwen2vl fix bug for #1971 #1897 (#1984) · a8aad935
  yizhang2077 authored Nov 11, 2024
  
  a8aad935
- docs: add shm size for docker run (#1986) · 47ffe7af
  Yineng Zhang authored Nov 10, 2024
  
  47ffe7af
- fix: update pyzmq version (#1983) · b3523af8
  Yineng Zhang authored Nov 10, 2024
  
  b3523af8
- Simplify prometheus metrics (#1981) · 1929c067
  Lianmin Zheng authored Nov 10, 2024
```
Co-authored-by: Mohit Reddy <mohitreddy1996@users.noreply.github.com>
```
  1929c067
- Specify `zmq` Version Requirement (#1982) · ed53ac84
  Huanzhi (Hans) Mao authored Nov 10, 2024
  
  ed53ac84
- [CI] balance unit tests (#1977) · 520f0094
  Lianmin Zheng authored Nov 09, 2024
  
  520f0094
09 Nov, 2024 8 commits
- Clean up metrics code (#1972) · 9c939a3d
  Lianmin Zheng authored Nov 09, 2024
  
  9c939a3d
- [Minor] Fix a typo in test_torchao.py (#1976) · 549e8b83
  Lianmin Zheng authored Nov 09, 2024
  
  549e8b83
- Update pr-test-rust.yml to add a "finish" step (#1975) · a1f32867
  Lianmin Zheng authored Nov 09, 2024
  
  a1f32867
- Update README.md (#1974) · 760552e0
  Lianmin Zheng authored Nov 09, 2024
  
  760552e0
- Introducing SGLang Guru on Gurubase.io (#1745) · d9aada9d
  Kursat Aktas authored Nov 09, 2024
  
  d9aada9d
- Initialize model_worker_batch variable (#1973) · f11eb90f
  Enrique Shockwave authored Nov 09, 2024
  
  f11eb90f
- Fix metrics (#1963) · 95a4ed12
  Yudi Xue authored Nov 08, 2024
  
  95a4ed12
- Updated Instructions on Profiling SGLang Infer System with AMD GPUs (#1966) · d1150e9a
  leishaoSC authored Nov 08, 2024
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  d1150e9a
08 Nov, 2024 13 commits
- Update README.md's Slack invitation link (#1962) · e3126e3c
  Chayenne authored Nov 08, 2024
  
  e3126e3c
- [minor] Improve code style and compatibility (#1961) · a5095520
  Lianmin Zheng authored Nov 08, 2024
  
  a5095520
- Add sentence_transformers to CI dependency (#1958) · 7ef0084b
  Lianmin Zheng authored Nov 08, 2024
  
  7ef0084b
- [Release, ROCm] release ROCm docker build for AMD MI GPUs (#1957) · f9a377f6
  HAI authored Nov 08, 2024
  
  f9a377f6
- Adjust reward model's score module and pooler module order for reducing computation (#1956) · 4ade15dd
  aqweteddy authored Nov 08, 2024
  
  4ade15dd
- Remove the useless to_srt_kwargs (#1955) · 8dc84da0
  Lianmin Zheng authored Nov 07, 2024
  
  8dc84da0
- Gemma2 reward model support (#1954) · f16eb15d
  aqweteddy authored Nov 08, 2024
  
  f16eb15d
- Monitoring documentation (#1933) · 5bc2508b
  Yudi Xue authored Nov 07, 2024
  
  5bc2508b
- Update setup_github_runner.md (#1952) · a71a44f2
  Lianmin Zheng authored Nov 07, 2024
  
  a71a44f2
- Add a timeout for execute-notebook.yml (#1951) · 691808d5
  Lianmin Zheng authored Nov 07, 2024
  
  691808d5
- [ENV, ROCm] update environment settings (#1939) · d32fba2a
  HAI authored Nov 07, 2024
  
  d32fba2a
- [Performance, Triton Kernel Args] extend_attention, optimize kern args to _fwd_kernel (#1941) · 67c424cc
  HAI authored Nov 07, 2024
  
  67c424cc
- [Doc] fix docs (#1949) · 1ae270c5
  Lianmin Zheng authored Nov 07, 2024
  
  1ae270c5
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05