introduction.md 1.27 KB
Newer Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
---
id: introduction
---

# Introduction

## Features

__SuperBench__ is a validation and profiling tool for AI infrastructure, which supports:

* AI infrastructure validation and diagnosis
  * Distributed validation tools to validate hundreds or thousands of servers automatically
  * Consider both raw hardware and E2E model performance with ML workload patterns
  * Build a contract to identify hardware issues
  * Provide infrastructural-oriented criteria as Performance/Quality Gates for hardware and system release
  * Provide detailed performance report and advanced analysis tool
* AI workload benchmarking and profiling
  * Provide comprehensive performance comparison between different existing hardware
  * Provide insights for hardware and software co-design

It includes micro-benchmark for primitive computation and communication benchmarking,
and model-benchmark to measure domain-aware end-to-end deep learning workloads.

:::note
SuperBench is in the early pre-alpha stage for open source, and not ready for general public yet.
If you want to jump in early, you can try building latest code yourself.
:::

## Overview

The following figure shows the capabilities provide by SuperBench core framework and its extension.

![SuperBench Structure](./assets/superbench_structure.png)