Commits · e321c9711306e35dc8cf905830ebe5b810ff1bc1 · zhaoyu6 / sglang

"examples/nas/legacy/cream/lib/utils/flops_table.py" did not exist on "604f8431d1670418312cecab213038b17988c92b"

22 Oct, 2025 5 commits
- [router] create worker removal step and clean up worker manager (#11921) · 5dccf697
  Simo Lin authored Oct 22, 2025
  
  5dccf697
- [router] Support multiple worker URLs for OpenAI router (#11723) · 77258ce0
  Keyang Ru authored Oct 22, 2025
  
  77258ce0
- [router][grpc] Fix background tasks stored with wrong id (#11945) · 590bc4b7
  Chang Su authored Oct 21, 2025
  
  590bc4b7
- [router] Add gRPC E2E test suite (#11790) · 63cfe1b0
  Keyang Ru authored Oct 21, 2025
  
  63cfe1b0
- [router][grpc] Support `v1/responses` API (#11926) · 70f6309c
  Chang Su authored Oct 21, 2025
  
  70f6309c
21 Oct, 2025 5 commits
- Fix openai input_text type compatibility (#11935) · 87a92e45
  Keyang Ru authored Oct 21, 2025
  
  87a92e45
- [router] clean up workflow logs to debug for implementation details logs (#11886) · 11110303
  Simo Lin authored Oct 20, 2025
  
  11110303
- [router][grpc] Remove `continue_final_message` in `ChatTemplateParams` and add... · e69094df
  Chang Su authored Oct 20, 2025
```
[router][grpc] Remove `continue_final_message` in `ChatTemplateParams` and add `minijinja-contrib` (#11882)
```
  e69094df
- [router] remove encoding header for oai router (#11881) · b4948512
  Simo Lin authored Oct 20, 2025
  
  b4948512
- [router] Worker Management Workflow Engine (#11868) · ddcba74b
  Simo Lin authored Oct 20, 2025
  
  ddcba74b
19 Oct, 2025 2 commits
- [2/2] [feature] support openai like classification api in router (#11670) · d513ee93
  ybyang authored Oct 19, 2025
  
  d513ee93
- [router] Add Configurable L0 and L1 Tokenizer Caching (#11688) · a7ae61ed
  Simo Lin authored Oct 18, 2025
  
  a7ae61ed
18 Oct, 2025 1 commit
- [router][grpc] Support parallel queue puts in grpc_request_manager and remove... · ca240eef
  Chang Su authored Oct 17, 2025
```
[router][grpc] Support parallel queue puts in grpc_request_manager and remove mutex for grpc_client (#11798)
```
  ca240eef
17 Oct, 2025 5 commits
- [router][grpc] Remove timeout for connections and remove `max_tokens`... · d1984e21
  Chang Su authored Oct 17, 2025
```
[router][grpc] Remove timeout for connections and remove `max_tokens` deprecation warning log (#11775)
```
  d1984e21
- [router] fix grpc client time out to 1h (#11768) · a5978a20
  Simo Lin authored Oct 17, 2025
  
  a5978a20
- [router] Fix UTF-8 Boundary Panic in Stop Sequence Decoder (#11766) · e483c1ea
  Simo Lin authored Oct 17, 2025
  
  e483c1ea
- Revert "[router] fix get_models endpoint for openai router (#11687)" (#11740) · 7780230a
  Keyang Ru authored Oct 16, 2025
  
  7780230a
- [router] Add rustfmt and set group imports by default (#11732) · dc01313d
  Chang Su authored Oct 16, 2025
  
  dc01313d
16 Oct, 2025 4 commits
- [router] Fix tool_choice normalization in ChatCompletionRequest and fix ut (#11731) · c7962868
  Chang Su authored Oct 16, 2025
  
  c7962868
- [router] fix p and d worker filtering and bootstrap port handling (#11729) · 64affab4
  Simo Lin authored Oct 16, 2025
  
  64affab4
- [Router] Refactor protocol definitions: split spec.rs into modular files (#11677) · 4c9bcb9d
  Keyang Ru authored Oct 16, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  4c9bcb9d
- [router] fix get_models endpoint for openai router (#11687) · 0975ba99
  Keyang Ru authored Oct 16, 2025
  
  0975ba99
15 Oct, 2025 4 commits
- [router] Refactor StopSequenceDecoder to Use Sequence for Incremental Decoding (#11676) · f5d30dae
  Simo Lin authored Oct 15, 2025
  
  f5d30dae
- [router][grpc] Simplify model_id determination (#11684) · 2479b894
  Chang Su authored Oct 15, 2025
  
  2479b894
- [router] Fix response api related spec (#11621) · d2478cd4
  Keyang Ru authored Oct 15, 2025
  
  d2478cd4
- [router] add worker self discovery for metadata (#11638) · 40e0082d
  Simo Lin authored Oct 14, 2025
  
  40e0082d
14 Oct, 2025 7 commits
- [router] cleanup app context and move to startup (#11617) · 3962e39d
  Simo Lin authored Oct 14, 2025
  
  3962e39d
- [router] add py binding and readme for openai router and history backend (#11453) · eb8cac6f
  Keyang Ru authored Oct 14, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  eb8cac6f
- [router] when given both local tokenizer and chat template, log all (#11601) · a04efc49
  Simo Lin authored Oct 14, 2025
  
  a04efc49
- [router] delete useless table content comment in spec (#11597) · 28ad2297
  Simo Lin authored Oct 14, 2025
  
  28ad2297
- [router] change worker api to async instead of sync (#11566) · 4b62af92
  Simo Lin authored Oct 14, 2025
  
  4b62af92
- [router] update generate spec to align with sgl io struct (#11591) · 0b9915c1
  Simo Lin authored Oct 14, 2025
  
  0b9915c1
- [router][protocols] Add Axum validate extractor and use it for... · 27ef1459
  Chang Su authored Oct 13, 2025
```
[router][protocols] Add Axum validate extractor and use it for `/v1/chat/completions` endpoint (#11588)
```
  27ef1459
13 Oct, 2025 7 commits
- [router][grpc] Add `serve_grpc` to `launch_server` and log id for HealthCheck (#11564) · 887c2b45
  Chang Su authored Oct 13, 2025
  
  887c2b45
- [router][grpc] Add error handling to `generate_tool_constraints` (#11562) · 4b694e7d
  Chang Su authored Oct 13, 2025
  
  4b694e7d
- [router] Add Rust CLI flags for queue size, timeout, and rate limit for token... · f4aa7880
  Jonah Bernard authored Oct 13, 2025
```
[router] Add Rust CLI flags for queue size, timeout, and rate limit for token bucket rate limiter (#11483)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  f4aa7880
- [router] allow user to specify chat template path (#11549) · 728af887
  Simo Lin authored Oct 13, 2025
  
  728af887
- [router][grpc] Further delegate non-stream processing to `processing.rs` (#11553) · 7b59b0b8
  Chang Su authored Oct 13, 2025
  
  7b59b0b8
- [router] allow tokenizer path to be dir (#11530) · 7c94eaee
  Simo Lin authored Oct 13, 2025
  
  7c94eaee
- [router] openai router: support grok model (#11511) · 63e84352
  Keyang Ru authored Oct 12, 2025
  
  63e84352