2021-12-24-release-0-4.md 1.5 KB
Newer Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
---
slug: release-sb-v0.4
title: Releasing SuperBench v0.4
author: Peng Cheng
author_title: SuperBench Team
author_url: https://github.com/cp5555
author_image_url: https://github.com/cp5555.png
tags: [superbench, announcement, release]
---

We are very happy to announce that **SuperBench 0.4.0 version** is officially released today!

You can install and try superbench by following [Getting Started Tutorial](https://microsoft.github.io/superbenchmark/docs/getting-started/installation).

## SuperBench 0.4.0 Release Notes

### SuperBench Framework

#### Monitor

- Add monitor framework for NVIDIA GPU, CPU, memory and disk.

#### Data Diagnosis and Analysis

- Support baseline-based data diagnosis.
- Support basic analysis feature (boxplot figure, outlier detection, etc.).

### Single-node Validation

#### Micro Benchmarks

- CPU Memory Validation (tool: Intel Memory Latency Checker).
- GPU Copy Bandwidth (tool: built by MSRA).
- Add ORT Model on AMD GPU platform.
- Add inference backend TensorRT.
- Add inference backend ORT.

### Multi-node Validation

#### Micro Benchmarks

- IB Networking validation.
- TCP validation (tool: TCPing).
- GPCNet Validation (tool: GPCNet).

### Other Improvement

1. Enhancement
   - Add pipeline for AMD docker.
   - Integrate system config info script with SuperBench.
   - Support FP32 mode without TF32.
   - Refine unit test for microbenchmark.
   - Unify metric names for all benchmarks.

2. Document
   - Add benchmark list
   - Add monitor document
   - Add data diagnosis document