Commits · ef995dae1e9e7cdc7cfa7d78a195a3943d7e3e6b · change / sglang · GitLab

07 Dec, 2024 2 commits
- [router] Health check on worker before adding to the router (#2392) · ef995dae
  Byron Hsu authored Dec 07, 2024
  
  ef995dae
- [router] Add remove worker api (#2380) · c36736c8
  Byron Hsu authored Dec 06, 2024
  
  c36736c8
06 Dec, 2024 4 commits
- [router] add remove tenant method in the radix tree (#2379) · 1bf9e347
  Byron Hsu authored Dec 06, 2024
  
  1bf9e347
- [Router] remove duplicate char count (#2378) · 499c85f1
  Byron Hsu authored Dec 06, 2024
  
  499c85f1
- [router] support `/add_worker` api (#2369) · 67b65794
  Byron Hsu authored Dec 06, 2024
  
  67b65794
- [router] use 2-gpu-runner (#2368) · 64fceab8
  Byron Hsu authored Dec 05, 2024
  
  64fceab8
03 Dec, 2024 2 commits
- [router] Copy license when publishing & bump version (#2339) · 04957965
  Byron Hsu authored Dec 03, 2024
  
  04957965
- Add missing license for router wheel (#2324) · 83b340e3
  Ata Fatahi authored Dec 03, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  83b340e3
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
27 Nov, 2024 2 commits
- Bump sglang-router to 0.0.10 for env name change (#2226) · 92d1253e
  Byron Hsu authored Nov 27, 2024
  
  92d1253e
- Rename DP_RANK to SGLANG_DP_RANK (#2218) · 2a02185c
  Lianmin Zheng authored Nov 27, 2024
  
  2a02185c
26 Nov, 2024 3 commits
- Fix rust warning (#2208) · 0b46b951
  Byron Hsu authored Nov 26, 2024
  
  0b46b951
- Bump router to 0.0.9 with better logging (#2207) · 2763c0a7
  Byron Hsu authored Nov 26, 2024
  
  2763c0a7
- [router] Rust e2e test (#2184) · 1f76fc6e
  Byron Hsu authored Nov 25, 2024
  
  1f76fc6e
25 Nov, 2024 4 commits
- [router] Replace print with logger (#2183) · 4d62bca5
  Byron Hsu authored Nov 25, 2024
  
  4d62bca5
- Bump rustls from 0.23.16 to 0.23.18 in /rust (#2182) · 5ada33ff
  dependabot[bot] authored Nov 26, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  5ada33ff
- Bump rust router to 0.0.8 · a866b65e
  Byron Hsu authored Nov 24, 2024
  
  a866b65e
- Replace prob based with threshold based load balancing (#2170) · 4b0a1c93
  Byron Hsu authored Nov 24, 2024
  
  4b0a1c93
24 Nov, 2024 2 commits
- Merged three native APIs into one: get_server_info (#2152) · dbe17293
  Henry Hyeonmok Ko authored Nov 24, 2024
  
  dbe17293
- Improve sglang router (#2148) · 32293a29
  Byron Hsu authored Nov 23, 2024
  
  32293a29
23 Nov, 2024 5 commits
- add prefix match for certain tenant (#2147) · 79216908
  Byron Hsu authored Nov 23, 2024
  
  79216908
- Add more api routes (completion, health, etc) to the router (#2146) · bbb81c24
  Byron Hsu authored Nov 23, 2024
  
  bbb81c24
- update router doc (#2143) · 145c0ddc
  Byron Hsu authored Nov 23, 2024
  
  145c0ddc
- Bump sglang-router to 0.0.5 (#2142) · 505d7f71
  Byron Hsu authored Nov 23, 2024
  
  505d7f71
- [router] cache-aware load-balancing router v1 (#2114) · cbedd1db
  Byron Hsu authored Nov 23, 2024
  
  cbedd1db
14 Nov, 2024 1 commit
- chore: open lto and optimization in release profile (#2028) · df246e69
  Tzu Gwo authored Nov 14, 2024
  
  df246e69
12 Nov, 2024 1 commit
- remove sglang folder in rust (#2010) · 602ebc66
  Byron Hsu authored Nov 11, 2024
  
  602ebc66
11 Nov, 2024 6 commits
- fix sglang_router not found (#2005) · 86c37d01
  Byron Hsu authored Nov 11, 2024
  
  86c37d01
- run rust test on ubuntu instead of 1-gpu-runner (#2003) · 3e335743
  Byron Hsu authored Nov 11, 2024
  
  3e335743
- Bump router to 0.0.3 (#2004) · 0d94f1dd
  Byron Hsu authored Nov 11, 2024
  
  0d94f1dd
- Fix rust unit test and pypi token (#2001) · 239eafbd
  Byron Hsu authored Nov 11, 2024
  
  239eafbd
- setup router python binding ci (#1999) · 00ffde20
  Byron Hsu authored Nov 11, 2024
  
  00ffde20
- [rust] cache-aware DP - approx tree (#1934) · f9633fa9
  Byron Hsu authored Nov 10, 2024
  
  f9633fa9
07 Nov, 2024 2 commits
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
- Add Rust Router Python Binding (#1891) · 4b1d7a25
  Austin Liu authored Nov 07, 2024
```
Signed-off-by: Austin Liu <austin362667@gmail.com>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
```
  4b1d7a25
06 Nov, 2024 2 commits
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
- [rust] refactor server and router (#1922) · 96766101
  Byron Hsu authored Nov 06, 2024
  
  96766101
04 Nov, 2024 1 commit
- [router] Impl radix tree and set up CI (#1893) · 530ff541
  Byron Hsu authored Nov 04, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  530ff541
28 Oct, 2024 1 commit
- [Router] Add a rust-based router (#1790) · 3839be29
  Byron Hsu authored Oct 28, 2024
  
  3839be29