- 05 Jul, 2023 1 commit
-
-
Yuting Jiang authored
**Description** add python code for DirecXGPUMemBw.
-
- 20 Mar, 2023 1 commit
-
-
Yuting Jiang authored
**Description** Support error tolerance in micro-benchmark for CuDNN function **Major Revision** - revise micro_base to support running the remaining commands run when one command failed in the microbenchmark - make error tolerance as true in cudnn functions
-
- 30 Dec, 2022 1 commit
-
-
Yuting Jiang authored
**Description** Add stdout logging util module and enable real-time logging flushing in executor **Major Revision** - Add stdout logging util module to redirect stdout into file log - enable stdout logging in executor to write benchmark output into both stdout and file `sb-bench.log` - enable real-time log flushing in run_command of microbenchmarks through config `log_flushing` **Minor Revision** - add log_n_step args to enable regular step time log in model benchmarks - udpate related docs
-
- 01 Apr, 2022 1 commit
-
-
guoshzhao authored
**Description** Use config `log_raw_data` to control whether log the raw data into file or not. The default value is `no`. We can set it as `yes` for some particular benchmarks to save the raw data into file, such as NCCL/RCCL test.
-
- 19 Jan, 2022 1 commit
-
-
guoshzhao authored
**Description** Add 50th, 90th, 95th, 99th, 99.9th latency metrics for ORT and pytorch inference benchmarks.
-
- 31 Aug, 2021 1 commit
-
-
guoshzhao authored
**Description** Package frequently-used subprocess invoke into function.
-
- 06 Aug, 2021 1 commit
-
-
guoshzhao authored
**Description** Replace `sum(results) / len(results)` with `statistics.mean(results)`
-
- 05 Aug, 2021 1 commit
-
-
guoshzhao authored
**Description** Add reduce function support for output summary. **Major Revision** - Add reducer class to maintain all reduce functions. - Save reduce type of each metric into `BenchmarkResult` - Fix UT.
-
- 26 May, 2021 1 commit
-
-
Yuting Jiang authored
* Unify SB_MICRO_PATH and SB_MICRO_LIB * fix bug of lib path
-
- 13 May, 2021 1 commit
-
-
guoshzhao authored
* Revise MicroBenchmark class to be more flexible. * use command index not the command as the parameter. * changes according to discussion.
-
- 08 Apr, 2021 1 commit
-
-
guoshzhao authored
* revise result process interface * add more comments Co-authored-by:Guoshuai Zhao <guzhao@microsoft.com>
-
- 24 Feb, 2021 1 commit
-
-
guoshzhao authored
* benchmarks init. Co-authored-by:Guoshuai Zhao <guzhao@microsoft.com>
-