1. 02 Sep, 2022 1 commit
    • Yuting Jiang's avatar
      Analyzer - Make baseline file optional in data diagnosis and fix bugs (#399) · db842892
      Yuting Jiang authored
      **Description**
       Make baseline check optional in data diagnosis and fix bugs.
      
      **Major Revision**
      - make baseline file optional in data diagnosis
      - fix bugs of output in md and excel format when 'function' is not in the rule
      - fix bug in multi_rules function that miss/failed test may failed the whole process
      
      **Minor Revision**
      - revise doc related with data diagnosis
      - resolve warning message about baseline not found check, only raise exception if baseline not found in the  'variance' function
      - move summary fields into top of json file
      - unify 'Index','machine' -> 'index' in output file
      db842892
  2. 09 Aug, 2022 1 commit
  3. 01 Aug, 2022 1 commit
    • Yuting Jiang's avatar
      Analyzer - Add failure check feature in data diagnosis (#378) · ec16d425
      Yuting Jiang authored
      **Description**
      Add failure check feature in data diagnosis.
      
      **Major Revision**
      - Add failure check rule op to support that if there exists metric_regex not been matched by any metric in result, label as failedtest
      - Split performance issue and failedtest in categories
      
      
      **Minor Revision**
      - replace DataFrame.append() with pd.concat since append() will be removed in later version of pandas
      ec16d425
  4. 01 Jun, 2022 1 commit
    • user4543's avatar
      Analyzer - Fix bugs in data diagnosis (#355) · 54da021b
      user4543 authored
      **Description**
      Fix bugs in data diagnosis.
      
      **Major Revision**
      - add support to get baseline of the metric which uses custom benchmark naming with ':' like 'nccl-bw:default/allreduce_8_bw:0'
      - save raw data of all metrics rather than metrics defined in diagnosis_rules.yaml when output_all is True
      - fix bug of using wrong column index when applying format(red color and percentile) in the excel
      54da021b
  5. 10 Apr, 2022 1 commit