"...runtime/git@developer.sourcefind.cn:change/sglang.git" did not exist on "815dce0554793d0788faf4eaacf0c7271c070e95"
Commit 1d609cd5 authored by Sanjeev Kumar's avatar Sanjeev Kumar Committed by Facebook GitHub Bot
Browse files

Dataset to model subclass mapping handling in hands eval pipeline

Summary: - Added support for running evaluation for models where the number of subclasses in the model output is less than the number of subclases in the annotated dataset

Reviewed By: vivekn

Differential Revision: D27090466

fbshipit-source-id: 704c438c1bbca333648c0477c412bf3ed79f04e7
parent f9c62b77
...@@ -32,6 +32,7 @@ def add_subclass_configs(cfg): ...@@ -32,6 +32,7 @@ def add_subclass_configs(cfg):
_C.MODEL.SUBCLASS.NUM_SUBCLASSES = 0 # must be set _C.MODEL.SUBCLASS.NUM_SUBCLASSES = 0 # must be set
_C.MODEL.SUBCLASS.NUM_LAYERS = 1 _C.MODEL.SUBCLASS.NUM_LAYERS = 1
_C.MODEL.SUBCLASS.SUBCLASS_ID_FETCHER = "SubclassFetcher" # ABC, must be set _C.MODEL.SUBCLASS.SUBCLASS_ID_FETCHER = "SubclassFetcher" # ABC, must be set
_C.MODEL.SUBCLASS.SUBCLASS_MAPPING = [] # subclass mapping from model output to annotation
class SubclassFetcher(ABC): class SubclassFetcher(ABC):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment