cpu.md

# CPU - Intel® Xeon®

## Validated Hardware

| Hardware                                 |
| ----------------------------------------- |
| [Intel® Xeon® 6 Processors](https://www.intel.com/content/www/us/en/products/details/processors/xeon.html)                   |
| [Intel® Xeon® 5 Processors](https://www.intel.com/content/www/us/en/products/docs/processors/xeon/5th-gen-xeon-scalable-processors.html)              |

## Recommended Models

### Text-only Language Models

| Model                                | Architecture                             | Supported |
|--------------------------------------|-------------------------------------------|-----------|
| meta-llama/Llama-3.1-8B-Instruct     | LlamaForCausalLM                          | ✅        |
| meta-llama/Llama-3.2-3B-Instruct     | LlamaForCausalLM                          | ✅        |
| ibm-granite/granite-3.2-2b-instruct  | GraniteForCausalLM                        | ✅        |
| Qwen/Qwen3-1.7B                      | Qwen3ForCausalLM                          | ✅        |
| Qwen/Qwen3-4B                        | Qwen3ForCausalLM                          | ✅        |
| Qwen/Qwen3-8B                        | Qwen3ForCausalLM                          | ✅        |
| zai-org/glm-4-9b-hf                  | GLMForCausalLM                            | ✅        |
| google/gemma-7b                      | GemmaForCausalLM                          | ✅        |

### Multimodal Language Models

| Model                                | Architecture                             | Supported |
|--------------------------------------|-------------------------------------------|-----------|
| Qwen/Qwen2.5-VL-7B-Instruct          | Qwen2VLForConditionalGeneration           | ✅        |
| openai/whisper-large-v3              | WhisperForConditionalGeneration           | ✅        |

✅ Runs and optimized.  
🟨 Runs and correct but not optimized to green yet.  
❌ Does not pass accuracy test or does not run.