• Yang An's avatar
    Add Chinese-CLIP implementation (#20368) · 72176402
    Yang An authored
    
    
    * init chinese-clip model from clip
    
    * init model tests and docs
    
    * implement chinese-clip into hf
    
    * implement chinese-clip into hf
    
    * implement chinese-clip into hf
    
    * implement chinese-clip into hf
    
    * implement chinese-clip into hf
    
    * update usecase example in model implementation
    
    * fix codestyle
    
    * fix model_type typo in readme
    
    * add placeholder in doc
    
    * add placeholder in doc
    
    * update the init script
    
    * update usecase
    
    * fix codestyle
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * forward the convert_rgb
    
    * update testcase
    
    * update testcase
    
    * update testcase
    
    * merge the recent update from clip about model_input_name property
    
    * update the doc
    
    * update the doc
    
    * update the doc
    
    * update the doc
    
    * remove unused imports
    
    * reformat code style
    
    * update the doc
    
    * fix isort style
    
    * bypass a weird failed unit test which is unrelated with my PR
    
    * update the doc
    
    * implement independent vision config class
    
    * implement independent vision model class
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * make style
    
    * fix refactor bug
    
    * make style
    
    * fix refactor bug
    
    * fix refactor bug
    
    * make style
    
    * fix refactor bug
    
    * fix refactor bug
    
    * doc-build restyle
    
    * implement independent text config class
    
    * implement independent text model class
    
    * implement independent text model class
    
    * make style
    
    * make fix-copies
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * fix refactor bug
    
    * make style
    
    * update doc
    
    * black and isort
    
    * update doc
    
    * Update src/transformers/models/chinese_clip/configuration_chinese_clip.py
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    * Update src/transformers/models/auto/tokenization_auto.py
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    * modify the model type from chinese-clip to chinese_clip
    
    * format the example comment of ChineseCLIPVisionConfig
    
    * correct the copyright comment
    
    * fix the tokenizer specification
    
    * add copied from for loss function
    
    * remove unused class
    
    * update CHINESE_CLIP_TEXT_INPUTS_DOCSTRING
    
    * update CHINESE_CLIP_INPUTS_DOCSTRING
    
    * update doc
    
    * update doc
    
    * update code comment in config
    
    * update copied from statement
    
    * make style
    
    * rename the doc file
    
    * add copied statement
    
    * remove unused attention_mask, causal_attention_mask in ChineseCLIPVisionEncoder
    
    * remove ChineseCLIPTextPreTrainedModel
    
    * fix bug
    
    * fix bug
    
    * fix bug
    
    * update doc
    
    * make style
    
    * Update src/transformers/models/chinese_clip/configuration_chinese_clip.py
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    * Update src/transformers/models/chinese_clip/configuration_chinese_clip.py
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    * update ChineseCLIPImageProcessor in image_processing_auto
    
    * fix config_class of chinesecliptextmodel
    
    * fix the test case
    
    * update the docs
    
    * remove the copied from comment for ChineseCLIPTextModel, since it has diverged from BertModel with customed config_class
    
    * update the testcase
    
    * final fix
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
    72176402
README.md 71.5 KB