Commits · ce3ed24ab7744db6f1e1018e2d19fed81575fd1c · tsoc / superbenchmark

16 Apr, 2021 2 commits
- Benchmarks: Code Revision - Fix some issue for BERT benchmark. (#58) · ce3ed24a
  guoshzhao authored Apr 16, 2021
```
Benchmarks: Code Revision - Fix some issue for BERT benchmark. (#58)
```
  ce3ed24a
- Benchmarks: Add Benchmark - Add GPT2 model benchmark. (#57) · af567cf6
  guoshzhao authored Apr 16, 2021
```
* Benchmarks: Add Benchmark - Add GPT2 model benchmark.
```
  af567cf6
14 Apr, 2021 2 commits

Benchmarks: Add Feature - Add interface to get all predefine parameters of all benchmarks. (#56) · fb850af7
guoshzhao authored Apr 14, 2021
```
* Benchmarks: Add Feature - Add interface to get all predefine parameters of all benchmarks.
```
fb850af7

Benchmarks: Add Benchmark - Add computation and communication overlap micro benchmark (#39) · 435b2d5e

Yuting Jiang authored Apr 14, 2021



* Benchmarks: Add Benchmark - add computation and communication overlap micro benchmark

* Benchmarks: Add benchmark - fix some format issues and typo

* Benchmarks: Add Benchmark - update according comments and add test

* revise tests

* skip multi gpu test due to no multi gpu
Co-authored-by: v-yujiang <v-yujiang@microsoft.com>

435b2d5e

12 Apr, 2021 6 commits
- add _post_process() implementation in sharding_matmul.py to clean up distributed resource. (#46) · 7f6deabb
  guoshzhao authored Apr 12, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  7f6deabb
- rename metric name of sharding-matmul (#48) · 7bd41649
  guoshzhao authored Apr 12, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  7bd41649
- remove unused code. (#47) · 020cefbd
  guoshzhao authored Apr 12, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  020cefbd
- change the condition when execute self.__matmul_nosharding() (#49) · 82e267b9
  guoshzhao authored Apr 12, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  82e267b9
- add _post_process() implementation in pytorch_base.py to clean up distributed resource. (#45) · 1f726091
  guoshzhao authored Apr 12, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  1f726091
- add _post_process() interface. (#40) · 0172968f
  guoshzhao authored Apr 12, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  0172968f
09 Apr, 2021 2 commits

Benchmarks: Fix Bug - Fix bug when validate the raw data format. (#35) · 02eef9ca
guoshzhao authored Apr 09, 2021
```
* fix raw data validation bug.
* address comments.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
02eef9ca

Benchmarks: Add Benchmark - Add op-sharding microbenchmark, including matmul... · f0f65a71

guoshzhao authored Apr 09, 2021


Benchmarks: Add Benchmark - Add op-sharding microbenchmark, including matmul and sharding_matmul. (#36)

* add microbenchmark - sharding matmul.
* address comments.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

f0f65a71

08 Apr, 2021 2 commits

Benchmarks: Code Revision - Revise BenchmarkRegistry interfaces for... · 923ce277

guoshzhao authored Apr 08, 2021


Benchmarks: Code Revision - Revise BenchmarkRegistry interfaces for integration with executor. (#33)

* revise BenchmarkRegistry interfaces.
* address comments
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

923ce277

Benchmarks: Code Revision - Revise result process interface and add result checking (#32) · 2871a68b
guoshzhao authored Apr 08, 2021
```
* revise result process interface

* add more comments
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
2871a68b

29 Mar, 2021 1 commit
- fix bug when convert Enum.value to string (#29) · dc493b1b
  guoshzhao authored Mar 29, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  dc493b1b
26 Mar, 2021 1 commit

Benchmarks: Add Benchmark - Add Pytorch BERT benchmarks, including bert-base... · 0972b223

guoshzhao authored Mar 26, 2021


Benchmarks: Add Benchmark - Add Pytorch BERT benchmarks, including bert-base and bert-large.   (#20)

* add pytorch bert benchmarks.

* revise code

* fix issue

* revise code.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

0972b223

22 Mar, 2021 2 commits

Benchmarks: Code Revision - Move benchmarks auto-registration from registry.py to __init__.py (#24) · 8d24d03d
guoshzhao authored Mar 22, 2021
```
* move benchmarks registration from registry.py to __init__.py

* revise __init__.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
8d24d03d

Benchmarks: Add Feature - Add benchmark finish check according to... · 5dfcc6be

guoshzhao authored Mar 22, 2021


Benchmarks: Add Feature - Add benchmark finish check according to num_warmup/num_steps and duration in ModelBenchmark class. (#25)

* add is_finished function

* reuse current time.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

5dfcc6be

18 Mar, 2021 3 commits

Benchmarks: Add Feature - Register all benchmarks by import... · 3be4d8ee

guoshzhao authored Mar 18, 2021


Benchmarks: Add Feature - Register all benchmarks by import model_benchmarks/micro_benchmarks/docker_benchmarks. (#21)

* clean code.

* minor change.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

3be4d8ee

Benchmarks: Add Feature - Add sample_count argument for ModelBenchmark. (#22) · c00dc670

guoshzhao authored Mar 18, 2021



* add sample_count argument.

* handle more condidatins.

* address comments.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

c00dc670

Benchmarks: Code Revision - Support benchmark re-registration, keep the latest one. (#23) · 31b6f085
guoshzhao authored Mar 18, 2021
```
* support benchmark re-registration.

* address comments
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
31b6f085

15 Mar, 2021 1 commit
- add more checks for PytorchBase module (#19) · 80f434cb
  guoshzhao authored Mar 15, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  80f434cb
11 Mar, 2021 1 commit

Benchmarks: Add Feature - Add random dataset for Pytorch. (#17) · ebea2d50

guoshzhao authored Mar 12, 2021



* add random dataset.

* install pytorch-cpu for test docker.

* fix typo

* add more test cases.

* address comments.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

ebea2d50

09 Mar, 2021 2 commits
- Benchmarks: Add Feature - Add flag to disable GPU. (#15) · 52848d2f
  guoshzhao authored Mar 10, 2021
```
* add flag to disable GPU.

* fix spelling

* fix unittest.

* address comments.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  52848d2f
- rename _cal_params_size as _cal_params_count. (#16) · 83a4e93f
  guoshzhao authored Mar 09, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  83a4e93f
08 Mar, 2021 2 commits

Benchmarks: Add Feature - Add pytorch base class (#11) · 088aa19a

guoshzhao authored Mar 08, 2021



* add pytorch base class

* address comments
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

088aa19a

Benchmarks: Add Feature - Add optimizer definition in Model Base (#13) · 52b52c2c

guoshzhao authored Mar 08, 2021



* add optimizer definition and function to create torch optimizer.

* move optimizer enum into model_base module.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

52b52c2c

04 Mar, 2021 2 commits
- add more checks for model base (#12) · 9388f8f5
  guoshzhao authored Mar 04, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  9388f8f5
- fix typos (#14) · abc6c991
  guoshzhao authored Mar 04, 2021
```
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  abc6c991
24 Feb, 2021 1 commit
- Benchmarks: Initialization - Add base class, registry, and result (#1) · 4c87a3e4
  guoshzhao authored Feb 24, 2021
```
* benchmarks init.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
```
  4c87a3e4