Commits · eb38c7d1cae1c616de3c1c0ce40353c720f7e3c7 · change / sglang

25 May, 2025 1 commit
- Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) · 1a399799
  Chao Yang authored May 24, 2025
  
  1a399799
21 May, 2025 1 commit
- [router] support http2 in router (#6487) · 669caa0a
  Zilin Zhu authored May 21, 2025
  
  669caa0a
17 May, 2025 1 commit
- [router] Add /list_workers endpoint to router (#6366) · e3bed74a
  Zilin Zhu authored May 18, 2025
  
  e3bed74a
29 Apr, 2025 1 commit
- [Misc] add service discovery for sgl router · 1468769b
  Simo Lin authored Apr 29, 2025
  
  1468769b
27 Apr, 2025 1 commit
- [Misc] add structure logging, write to file and log tracing for SGL Router · f0365820
  Simo Lin authored Apr 27, 2025
  
  f0365820
17 Mar, 2025 1 commit

[sgl-router] improvement to avoid hang (#4482) · f4d7ab7a

Yinghai Lu authored Mar 17, 2025


Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>

f4d7ab7a

24 Jan, 2025 1 commit
- [router] Forward all request headers from router to workers (#3070) · 9a0cc2e9
  Byron Hsu authored Jan 23, 2025
  
  9a0cc2e9
20 Jan, 2025 1 commit
- [router] Expose worker startup secs & Return error instead of panic for router init (#3016) · 0311ce8e
  Byron Hsu authored Jan 20, 2025
  
  0311ce8e
12 Dec, 2024 2 commits
- Rename rust folder to sgl-router (#2464) · e3b3acfa
  Ata Fatahi authored Dec 12, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  e3b3acfa
- Make request payload size configurable (#2444) · 2ac36b9a
  Ata Fatahi authored Dec 11, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  2ac36b9a
11 Dec, 2024 3 commits
- [router] Update doc for dynamic scaling and fault tolerance (#2454) · c0ee46fe
  Byron Hsu authored Dec 11, 2024
  
  c0ee46fe
- [router] Use borrow if possible to save cost (#2441) · 0fb88aaa
  Byron Hsu authored Dec 11, 2024
  
  0fb88aaa
- [router] Refactor: decouple select and send stage (#2440) · d4de9a62
  Byron Hsu authored Dec 11, 2024
  
  d4de9a62
09 Dec, 2024 1 commit
- [router] add health checking in router init (#2393) · 6387098f
  Byron Hsu authored Dec 08, 2024
  
  6387098f
07 Dec, 2024 2 commits
- [router] Health check on worker before adding to the router (#2392) · ef995dae
  Byron Hsu authored Dec 07, 2024
  
  ef995dae
- [router] Add remove worker api (#2380) · c36736c8
  Byron Hsu authored Dec 06, 2024
  
  c36736c8
06 Dec, 2024 2 commits
- [Router] remove duplicate char count (#2378) · 499c85f1
  Byron Hsu authored Dec 06, 2024
  
  499c85f1
- [router] support `/add_worker` api (#2369) · 67b65794
  Byron Hsu authored Dec 06, 2024
  
  67b65794
26 Nov, 2024 1 commit
- Fix rust warning (#2208) · 0b46b951
  Byron Hsu authored Nov 26, 2024
  
  0b46b951
25 Nov, 2024 1 commit
- [router] Replace print with logger (#2183) · 4d62bca5
  Byron Hsu authored Nov 25, 2024
  
  4d62bca5
24 Nov, 2024 1 commit
- Merged three native APIs into one: get_server_info (#2152) · dbe17293
  Henry Hyeonmok Ko authored Nov 24, 2024
  
  dbe17293
23 Nov, 2024 2 commits
- Add more api routes (completion, health, etc) to the router (#2146) · bbb81c24
  Byron Hsu authored Nov 23, 2024
  
  bbb81c24
- [router] cache-aware load-balancing router v1 (#2114) · cbedd1db
  Byron Hsu authored Nov 23, 2024
  
  cbedd1db
11 Nov, 2024 1 commit
- [rust] cache-aware DP - approx tree (#1934) · f9633fa9
  Byron Hsu authored Nov 10, 2024
  
  f9633fa9
06 Nov, 2024 1 commit
- [rust] refactor server and router (#1922) · 96766101
  Byron Hsu authored Nov 06, 2024
  
  96766101
04 Nov, 2024 1 commit
- [router] Impl radix tree and set up CI (#1893) · 530ff541
  Byron Hsu authored Nov 04, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  530ff541
28 Oct, 2024 1 commit
- [Router] Add a rust-based router (#1790) · 3839be29
  Byron Hsu authored Oct 28, 2024
  
  3839be29