# | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr| # |-------------------------------------------|-------|------|-----:|--------|-----:|---|-----:| # | - inverse_scaling_hindsight_neglect_10shot| 0|none | 0|acc |0.4476|± |0.0281| # | | |none | 0|acc_norm|0.4476|± |0.0281| # |inverse_scaling_mc |N/A |none | 0|acc_norm|0.6273|± |0.0096| # | | |none | 0|acc |0.6210|± |0.0095| # | - inverse_scaling_neqa | 0|none | 0|acc |0.5300|± |0.0289| # | | |none | 0|acc_norm|0.5300|± |0.0289| # | - inverse_scaling_quote_repetition | 0|none | 0|acc |0.9367|± |0.0141| # | | |none | 0|acc_norm|0.9367|± |0.0141| # | - inverse_scaling_redefine_math | 0|none | 0|acc |0.7178|± |0.0150| # | | |none | 0|acc_norm|0.7178|± |0.0150| # | - inverse_scaling_winobias_antistereotype | 0|none | 0|acc |0.3786|± |0.0239| # | | |none | 0|acc_norm|0.4126|± |0.0243| # | Groups |Version|Filter|n-shot| Metric |Value | |Stderr| # |------------------|-------|------|-----:|--------|-----:|---|-----:| # |inverse_scaling_mc|N/A |none | 0|acc_norm|0.6273|± |0.0096| # | | |none | 0|acc |0.6210|± |0.0095| # hf (pretrained=facebook/opt-2.7b,add_bos_token=True,dtype=float32), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto (32) # | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr| # |-------------------------------------------|-------|------|-----:|--------|-----:|---|-----:| # | - inverse_scaling_hindsight_neglect_10shot| 0|none | 0|acc |0.4476|± |0.0281| # | | |none | 0|acc_norm|0.4476|± |0.0281| # |inverse_scaling_mc |N/A |none | 0|acc_norm|0.6291|± |0.0095| # | | |none | 0|acc |0.6219|± |0.0095| # | - inverse_scaling_neqa | 0|none | 0|acc |0.5267|± |0.0289| # | | |none | 0|acc_norm|0.5267|± |0.0289| # | - inverse_scaling_quote_repetition | 0|none | 0|acc |0.9433|± |0.0134| # | | |none | 0|acc_norm|0.9433|± |0.0134| # | - inverse_scaling_redefine_math | 0|none | 0|acc |0.7200|± |0.0150| # | | |none | 0|acc_norm|0.7200|± |0.0150| # | - inverse_scaling_winobias_antistereotype | 0|none | 0|acc |0.3762|± |0.0239| # | | |none | 0|acc_norm|0.4150|± |0.0243| # | Groups |Version|Filter|n-shot| Metric |Value | |Stderr| # |------------------|-------|------|-----:|--------|-----:|---|-----:| # |inverse_scaling_mc|N/A |none | 0|acc_norm|0.6291|± |0.0095| # | | |none | 0|acc |0.6219|± |0.0095|