Commits · f5d30dae89fd413cabd2d573c2eed9907d233dcb · change / sglang

"megatron/training/__init__.py" did not exist on "ef59b68720a787eebbc7bbf186f333f807aaf02e"

15 Oct, 2025 5 commits
- [router] Refactor StopSequenceDecoder to Use Sequence for Incremental Decoding (#11676) · f5d30dae
  Simo Lin authored Oct 15, 2025
  
  f5d30dae
- [router][grpc] Simplify model_id determination (#11684) · 2479b894
  Chang Su authored Oct 15, 2025
  
  2479b894
- [router] Fix response api related spec (#11621) · d2478cd4
  Keyang Ru authored Oct 15, 2025
  
  d2478cd4
- [router] upgrade to 0.2.0 (#11642) · 74737b28
  Simo Lin authored Oct 14, 2025
  
  74737b28
- [router] add worker self discovery for metadata (#11638) · 40e0082d
  Simo Lin authored Oct 14, 2025
  
  40e0082d
14 Oct, 2025 10 commits
- [router] update router readme to latest features (#11619) · 49345a68
  Simo Lin authored Oct 14, 2025
  
  49345a68
- [router] add chang and keyang to sgl router author (#11620) · 9e8a15a7
  Simo Lin authored Oct 14, 2025
  
  9e8a15a7
- [router] cleanup app context and move to startup (#11617) · 3962e39d
  Simo Lin authored Oct 14, 2025
  
  3962e39d
- [router] add py binding and readme for openai router and history backend (#11453) · eb8cac6f
  Keyang Ru authored Oct 14, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  eb8cac6f
- [router] when given both local tokenizer and chat template, log all (#11601) · a04efc49
  Simo Lin authored Oct 14, 2025
  
  a04efc49
- [router] allow router launch server to use grpc mode (#11600) · da7fac1b
  Simo Lin authored Oct 14, 2025
  
  da7fac1b
- [router] delete useless table content comment in spec (#11597) · 28ad2297
  Simo Lin authored Oct 14, 2025
  
  28ad2297
- [router] change worker api to async instead of sync (#11566) · 4b62af92
  Simo Lin authored Oct 14, 2025
  
  4b62af92
- [router] update generate spec to align with sgl io struct (#11591) · 0b9915c1
  Simo Lin authored Oct 14, 2025
  
  0b9915c1
- [router][protocols] Add Axum validate extractor and use it for... · 27ef1459
  Chang Su authored Oct 13, 2025
```
[router][protocols] Add Axum validate extractor and use it for `/v1/chat/completions` endpoint (#11588)
```
  27ef1459
13 Oct, 2025 7 commits
- [router][grpc] Add `serve_grpc` to `launch_server` and log id for HealthCheck (#11564) · 887c2b45
  Chang Su authored Oct 13, 2025
  
  887c2b45
- [router][grpc] Add error handling to `generate_tool_constraints` (#11562) · 4b694e7d
  Chang Su authored Oct 13, 2025
  
  4b694e7d
- [router] Add Rust CLI flags for queue size, timeout, and rate limit for token... · f4aa7880
  Jonah Bernard authored Oct 13, 2025
```
[router] Add Rust CLI flags for queue size, timeout, and rate limit for token bucket rate limiter (#11483)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  f4aa7880
- [router] allow user to specify chat template path (#11549) · 728af887
  Simo Lin authored Oct 13, 2025
  
  728af887
- [router][grpc] Further delegate non-stream processing to `processing.rs` (#11553) · 7b59b0b8
  Chang Su authored Oct 13, 2025
  
  7b59b0b8
- [router] allow tokenizer path to be dir (#11530) · 7c94eaee
  Simo Lin authored Oct 13, 2025
  
  7c94eaee
- [router] openai router: support grok model (#11511) · 63e84352
  Keyang Ru authored Oct 12, 2025
  
  63e84352
12 Oct, 2025 2 commits
- Fix the GPT function calling regex to allow dash in the name (#10577) · ec1cd90a
  Antoine Roux authored Oct 12, 2025
  
  ec1cd90a
- [Router]: Small Typo in a comment within tree.rs (#11489) · 9b5efe34
  Wenyi Xu authored Oct 12, 2025
  
  9b5efe34
11 Oct, 2025 4 commits
- Super tiny delete unused openai router in sgl-router (#11448) · d957177a
  fzyzcjy authored Oct 11, 2025
  
  d957177a
- [router][grpc] Consolidate parser checks for chat completions (#11439) · 92777135
  Chang Su authored Oct 10, 2025
  
  92777135
- [router] leverage RAII to actively cancel request during client disconnect (#11399) · c4958331
  Simo Lin authored Oct 10, 2025
  
  c4958331
- [router] disable rate limiter by default (#11435) · 2eeb2751
  Simo Lin authored Oct 10, 2025
  
  2eeb2751
10 Oct, 2025 1 commit
- [router] Fix ci nvcc not found error (#11411) · a0835c3a
  Keyang Ru authored Oct 10, 2025
  
  a0835c3a
09 Oct, 2025 6 commits
- [router] conversation item API: create, retrieve and delete (#11369) · eb7d9261
  Keyang Ru authored Oct 09, 2025
  
  eb7d9261
- [router] change grpc client from mutable to clone (#11394) · 88bb627d
  Simo Lin authored Oct 09, 2025
  
  88bb627d
- [router][grpc] Fix streaming bugs: empty tool names, state pollution, and panics (#11373) · ab926dd6
  Chang Su authored Oct 09, 2025
  
  ab926dd6
- [router][lint] Add unused_qualifications to cargo lint warnings (#11366) · a0557642
  Chang Su authored Oct 08, 2025
  
  a0557642
- [router] Refactor OpenAI router: split monolithic file and move location (#11359) · 84768d10
  Keyang Ru authored Oct 08, 2025
  
  84768d10
- [router][grpc] disable health check generation and increase timeout (#11353) · 368fd206
  Simo Lin authored Oct 08, 2025
  
  368fd206
08 Oct, 2025 5 commits
- [router][grpc] Add dependencies in Cargo.toml to support chat template rendering (#11342) · fccac7d1
  Chang Su authored Oct 08, 2025
  
  fccac7d1
- [router] Support history management using conversation (#11339) · 7ac6b900
  Keyang Ru authored Oct 08, 2025
  
  7ac6b900
- [router] Fix all unused_qualifications (#11341) · a1080b72
  Chang Su authored Oct 08, 2025
  
  a1080b72
- [router][grpc] Cleanup debug logs in grpc_server and grpc_router (#11340) · a65ca739
  Chang Su authored Oct 08, 2025
  
  a65ca739
- [router] improve reasoning parser lock and reduce req cloning (#11336) · 677aa0e2
  Simo Lin authored Oct 08, 2025
  
  677aa0e2