Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
cpu.md 1.48 KB
Newer Older
Louie Tsai's avatar
Add CPU support model (#28697)  
Louie Tsai committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26 
# CPU - Intel® Xeon®

## Supported Models

### Text-only Language Models

| Model                                | Architecture                             | Supported |
|--------------------------------------|-------------------------------------------|-----------|
| meta-llama/Llama-3.1 / 3.3           | LlamaForCausalLM                          | ✅        |
| meta-llama/Llama-4-Scout             | Llama4ForConditionalGeneration            | ✅        |
| meta-llama/Llama-4-Maverick          | Llama4ForConditionalGeneration            | ✅        |
| ibm-granite/granite (Granite-MOE)    | GraniteMoeForCausalLM                     | ✅        |
| Qwen/Qwen3                           | Qwen3ForCausalLM                          | ✅        |
| zai-org/GLM-4.5                      | GLMForCausalLM                            | ✅        |
| google/gemma                         | GemmaForCausalLM                          | ✅        |

### Multimodal Language Models

| Model                                | Architecture                             | Supported |
|--------------------------------------|-------------------------------------------|-----------|
| Qwen/Qwen2.5-VL                      | Qwen2VLForConditionalGeneration           | ✅        |
| openai/whisper                       | WhisperForConditionalGeneration           | ✅        |

✅ Runs and optimized.  
🟨 Runs and correct but not optimized to green yet.  
❌ Does not pass accuracy test or does not run.