1. 02 Sep, 2022 1 commit
    • Yuting Jiang's avatar
      Analyzer - Make baseline file optional in data diagnosis and fix bugs (#399) · db842892
      Yuting Jiang authored
      **Description**
       Make baseline check optional in data diagnosis and fix bugs.
      
      **Major Revision**
      - make baseline file optional in data diagnosis
      - fix bugs of output in md and excel format when 'function' is not in the rule
      - fix bug in multi_rules function that miss/failed test may failed the whole process
      
      **Minor Revision**
      - revise doc related with data diagnosis
      - resolve warning message about baseline not found check, only raise exception if baseline not found in the  'variance' function
      - move summary fields into top of json file
      - unify 'Index','machine' -> 'index' in output file
      db842892
  2. 22 Aug, 2022 1 commit
  3. 29 Apr, 2022 1 commit
    • Yifan Xiong's avatar
      Release - SuperBench v0.5.0 (#350) · 6681c720
      Yifan Xiong authored
      
      
      **Description**
      
      Cherry-pick  bug fixes from v0.5.0 to main.
      
      **Major Revisions**
      
      * Bug - Force to fix ort version as '1.10.0' (#343)
      * Bug - Support no matching rules and unify the output name in result_summary (#345)
      * Analyzer - Support regex in annotations of benchmark naming for metrics in rules (#344)
      * Bug - Fix bugs in sync results on root rank for e2e model benchmarks (#342)
      * Bug - Fix bug of duration feature for model benchmarks in distributed mode (#347)
      * Docs - Upgrade version and release note (#348)
      Co-authored-by: default avatarYuting Jiang <v-yutjiang@microsoft.com>
      6681c720
  4. 20 Apr, 2022 1 commit
  5. 20 Feb, 2022 1 commit
  6. 30 Jan, 2022 1 commit
  7. 30 Dec, 2021 1 commit
    • Yifan Xiong's avatar
      Release - SuperBench v0.4.0 (#278) · ff563b66
      Yifan Xiong authored
      
      
      __Description__
      
      Cherry-pick  bug fixes from v0.4.0 to main.
      
      __Major Revisions__
      
      * Bug - Fix issues for Ansible and benchmarks (#267)
      * Tests - Refine test cases for microbenchmark (#268)
      * Bug - Build openmpi with ucx support in rocm dockerfiles (#269)
      * Benchmarks: Fix Bug - Fix fio build issue (#272)
      * Docs - Unify metric and add doc for cublas and cudnn functions (#271)
      * Monitor: Revision - Add 'monitor/' prefix to monitor metrics in result summary (#274)
      * Bug - Fix bug of detecting if gpu_index is none (#275)
      * Bug - Fix bugs in data diagnosis (#273)
      * Bug - Fix issue that the root mpi rank may not be the first in the hostfile (#270)
      * Benchmarks: Configuration - Update inference and network benchmarks in configs (#276)
      * Docs - Upgrade version and release note (#277)
      Co-authored-by: default avatarYuting Jiang <v-yutjiang@microsoft.com>
      ff563b66
  8. 14 Dec, 2021 1 commit
  9. 06 Dec, 2021 1 commit