Unverified Commit 506e5de8 authored by simveit's avatar simveit Committed by GitHub
Browse files

Improve supported models doc (#6430)

parent 844e2f22
...@@ -43,7 +43,7 @@ print("Embeddings:", [x.get("embedding") for x in response.get("data", [])]) ...@@ -43,7 +43,7 @@ print("Embeddings:", [x.get("embedding") for x in response.get("data", [])])
``` ```
## Supporting Matrixs ## Supported models
| Model Family (Embedding) | Example HuggingFace Identifier | Chat Template | Description | | Model Family (Embedding) | Example HuggingFace Identifier | Chat Template | Description |
|-------------------------------------------------|-----------------------------------------------|---------------|--------------------------------------------------------------------------------------------------------------------------------------| |-------------------------------------------------|-----------------------------------------------|---------------|--------------------------------------------------------------------------------------------------------------------------------------|
......
...@@ -11,8 +11,15 @@ python3 -m sglang.launch_server \ ...@@ -11,8 +11,15 @@ python3 -m sglang.launch_server \
--port 30000 \ --port 30000 \
``` ```
## Supporting Matrixs ## Supported models
Below the supported models are summarized in a table.
If unsure if a specific architecture is implemented you may look it up via github search for example to search for `Qwen3ForCausalLm` use the expression
```
repo:sgl-project/sglang path:/^python\/sglang\/srt\/models\// Qwen3ForCausalLm
```
in Github search.
| Model Family (Variants) | Example HuggingFace Identifier | Description | | Model Family (Variants) | Example HuggingFace Identifier | Description |
|-------------------------------------|--------------------------------------------------|----------------------------------------------------------------------------------------| |-------------------------------------|--------------------------------------------------|----------------------------------------------------------------------------------------|
......
# Multimodal Language Models # Multimodal Language Models
These models accept multi-modal inputs (e.g., images and text) and generate text output. They augment language models These models accept multi-modal inputs (e.g., images and text) and generate text output. They augment language models with multimodal encoders.
with multimodal encoders.
## Example launch Command ## Example launch Command
...@@ -12,7 +11,16 @@ python3 -m sglang.launch_server \ ...@@ -12,7 +11,16 @@ python3 -m sglang.launch_server \
--port 30000 \ --port 30000 \
``` ```
## Supporting Metrics ## Supported models
Below the supported models are summarized in a table.
If unsure if a specific architecture is implemented you may look it up via Github search. For example to search for `Qwen2_5_VLForConditionalGeneration` use the expression
```
repo:sgl-project/sglang path:/^python\/sglang\/srt\/models\// Qwen2_5_VLForConditionalGeneration
```
in Github search.
| Model Family (Variants) | Example HuggingFace Identifier | Chat Template | Description | | Model Family (Variants) | Example HuggingFace Identifier | Chat Template | Description |
|----------------------------|--------------------------------------------|------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |----------------------------|--------------------------------------------|------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
......
...@@ -17,7 +17,7 @@ python3 -m sglang.launch_server \ ...@@ -17,7 +17,7 @@ python3 -m sglang.launch_server \
--port 30000 \ --port 30000 \
``` ```
## Supporting Matrixs ## Supported models
| Model Family (Reward) | Example HuggingFace Identifier | Description | | Model Family (Reward) | Example HuggingFace Identifier | Description |
|---------------------------------------------------------------------------|-----------------------------------------------------|---------------------------------------------------------------------------------| |---------------------------------------------------------------------------|-----------------------------------------------------|---------------------------------------------------------------------------------|
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment