Commits · 2a717c5078ed5feb7c8df70943e25d27e50a89eb · change / sglang

09 Dec, 2024 1 commit
- [Router] fix interrupt from terminal (#2413) · 2a717c50
  Byron Hsu authored Dec 08, 2024
  
  2a717c50
08 Dec, 2024 1 commit
- [router] Improve cleanup logic (#2411) · a1e697b2
  Byron Hsu authored Dec 08, 2024
  
  a1e697b2
27 Nov, 2024 1 commit
- Rename DP_RANK to SGLANG_DP_RANK (#2218) · 2a02185c
  Lianmin Zheng authored Nov 27, 2024
  
  2a02185c
25 Nov, 2024 2 commits
- [router] Replace print with logger (#2183) · 4d62bca5
  Byron Hsu authored Nov 25, 2024
  
  4d62bca5
- Replace prob based with threshold based load balancing (#2170) · 4b0a1c93
  Byron Hsu authored Nov 24, 2024
  
  4b0a1c93
24 Nov, 2024 1 commit
- Improve sglang router (#2148) · 32293a29
  Byron Hsu authored Nov 23, 2024
  
  32293a29
23 Nov, 2024 1 commit
- [router] cache-aware load-balancing router v1 (#2114) · cbedd1db
  Byron Hsu authored Nov 23, 2024
  
  cbedd1db
11 Nov, 2024 3 commits
- fix sglang_router not found (#2005) · 86c37d01
  Byron Hsu authored Nov 11, 2024
  
  86c37d01
- setup router python binding ci (#1999) · 00ffde20
  Byron Hsu authored Nov 11, 2024
  
  00ffde20
- [rust] cache-aware DP - approx tree (#1934) · f9633fa9
  Byron Hsu authored Nov 10, 2024
  
  f9633fa9