AutoImageProcessor (#20111)

* AutoImageProcessor skeleton

* Update references

* Add mapping in init

* Add model image processors to __init__ for importing

* Add AutoImageProcessor tests

* Fix up

* Image Processor documentation

* Remove pdb

* Update docs/source/en/model_doc/mobilevit.mdx

* Update docs

* Don't add whitespace on json files

* Remove fixtures

* Move checking model config down

* Fix up

* Add check for image processor

* Remove FeatureExtractorMixin in docstrings

* Rename model_tmpfile to config_tmpfile

* Don't make None if not in image processor map

docs/source/en/_toctree.yml

@@ -183,6 +183,8 @@
       title: DeepSpeed Integration
     - local: main_classes/feature_extractor
       title: Feature Extractor
+    - local: main_classes/image_processor
+      title: Image Processor
     title: Main Classes
   - sections:
     - isExpanded: false

docs/source/en/internal/image_processing_utils.mdx

@@ -29,6 +29,6 @@ Most of those are only useful if you are studying the code of the image processo
 
 [[autodoc]] image_transforms.to_pil_image
 
-## ImageProcessorMixin
+## ImageProcessingMixin
 
-[[autodoc]] image_processing_utils.ImageProcessorMixin
+[[autodoc]] image_processing_utils.ImageProcessingMixin

docs/source/en/main_classes/image_processor.mdx

+<!--Copyright 2022 The HuggingFace Team. All rights reserved.
+
+Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
+an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
+specific language governing permissions and limitations under the License.
+-->
+
+# Image Processor
+
+An image processor is in charge of preparing input features for vision models and post processing their outputs. This includes transformations such as resizing, normalization, and conversion to PyTorch, TensorFlow, Flax and Numpy tensors. It may also include model specific post-processing such as converting logits to segmentation masks.
+
+
+## ImageProcessingMixin
+
+[[autodoc]] image_processing_utils.ImageProcessingMixin
+    - from_pretrained
+    - save_pretrained
+
+## BatchFeature
+
+[[autodoc]] BatchFeature
+
+## BaseImageProcessor
+
+[[autodoc]] image_processing_utils.BaseImageProcessor

docs/source/en/model_doc/auto.mdx

@@ -66,6 +66,10 @@ Likewise, if your `NewModel` is a subclass of [`PreTrainedModel`], make sure its
 
 [[autodoc]] AutoFeatureExtractor
 
+## AutoImageProcessor
+
+[[autodoc]] AutoImageProcessor
+
 ## AutoProcessor
 
 [[autodoc]] AutoProcessor

docs/source/en/model_doc/beit.mdx

@@ -84,6 +84,12 @@ contributed by [kamalkraj](https://huggingface.co/kamalkraj). The original code
     - __call__
     - post_process_semantic_segmentation
 
+## BeitImageProcessor
+
+[[autodoc]] BeitImageProcessor
+    - preprocess
+    - post_process_semantic_segmentation
+
 ## BeitModel
 
 [[autodoc]] BeitModel

docs/source/en/model_doc/clip.mdx

@@ -100,6 +100,11 @@ This model was contributed by [valhalla](https://huggingface.co/valhalla). The o
 
 [[autodoc]] CLIPTokenizerFast
 
+## CLIPImageProcessor
+
+[[autodoc]] CLIPImageProcessor
+    - preprocess
+
 ## CLIPFeatureExtractor
 
 [[autodoc]] CLIPFeatureExtractor

docs/source/en/model_doc/convnext.mdx

@@ -50,6 +50,11 @@ This model was contributed by [nielsr](https://huggingface.co/nielsr). TensorFlo
 [[autodoc]] ConvNextFeatureExtractor
 
 
+## ConvNextImageProcessor
+
+[[autodoc]] ConvNextImageProcessor
+    - preprocess
+
 ## ConvNextModel
 
 [[autodoc]] ConvNextModel

docs/source/en/model_doc/deit.mdx

@@ -81,6 +81,11 @@ This model was contributed by [nielsr](https://huggingface.co/nielsr). The Tenso
 [[autodoc]] DeiTFeatureExtractor
     - __call__
 
+## DeiTImageProcessor
+
+[[autodoc]] DeiTImageProcessor
+    - preprocess
+
 ## DeiTModel
 
 [[autodoc]] DeiTModel

docs/source/en/model_doc/dpt.mdx

@@ -40,6 +40,13 @@ This model was contributed by [nielsr](https://huggingface.co/nielsr). The origi
     - post_process_semantic_segmentation
 
 
+## DPTImageProcessor
+
+[[autodoc]] DPTImageProcessor
+    - preprocess
+    - post_process_semantic_segmentation
+
+
 ## DPTModel
 
 [[autodoc]] DPTModel

docs/source/en/model_doc/flava.mdx

@@ -61,6 +61,11 @@ This model was contributed by [aps](https://huggingface.co/aps). The original co
 
 [[autodoc]] FlavaFeatureExtractor
 
+## FlavaImageProcessor
+
+[[autodoc]] FlavaImageProcessor
+    - preprocess
+
 ## FlavaForPreTraining
 
 [[autodoc]] FlavaForPreTraining

docs/source/en/model_doc/glpn.mdx

@@ -50,6 +50,11 @@ This model was contributed by [nielsr](https://huggingface.co/nielsr). The origi
 [[autodoc]] GLPNFeatureExtractor
     - __call__
 
+## GLPNImageProcessor
+
+[[autodoc]] GLPNImageProcessor
+    - preprocess
+
 ## GLPNModel
 
 [[autodoc]] GLPNModel

docs/source/en/model_doc/imagegpt.mdx

@@ -81,6 +81,11 @@ Tips:
 
     - __call__
 
+## ImageGPTImageProcessor
+
+[[autodoc]] ImageGPTImageProcessor
+    - preprocess
+
 ## ImageGPTModel
 
 [[autodoc]] ImageGPTModel

docs/source/en/model_doc/layoutlmv2.mdx

@@ -275,6 +275,11 @@ print(encoding.keys())
 [[autodoc]] LayoutLMv2FeatureExtractor
     - __call__
 
+## LayoutLMv2ImageProcessor
+
+[[autodoc]] LayoutLMv2ImageProcessor
+    - preprocess
+
 ## LayoutLMv2Tokenizer
 
 [[autodoc]] LayoutLMv2Tokenizer

docs/source/en/model_doc/layoutlmv3.mdx

@@ -73,6 +73,11 @@ LayoutLMv3 is nearly identical to LayoutLMv2, so we've also included LayoutLMv2
 [[autodoc]] LayoutLMv3FeatureExtractor
     - __call__
 
+## LayoutLMv3ImageProcessor
+
+[[autodoc]] LayoutLMv3ImageProcessor
+    - preprocess
+
 ## LayoutLMv3Tokenizer
 
 [[autodoc]] LayoutLMv3Tokenizer

docs/source/en/model_doc/levit.mdx

@@ -71,6 +71,12 @@ This model was contributed by [anugunj](https://huggingface.co/anugunj). The ori
 [[autodoc]] LevitFeatureExtractor
     - __call__
 
+## LevitImageProcessor
+
+  [[autodoc]] LevitImageProcessor
+    - preprocess
+
+
 ## LevitModel
 
 [[autodoc]] LevitModel

docs/source/en/model_doc/mobilevit.mdx

@@ -68,6 +68,12 @@ This model was contributed by [matthijs](https://huggingface.co/Matthijs). The T
     - __call__
     - post_process_semantic_segmentation
 
+## MobileViTImageProcessor
+
+[[autodoc]] MobileViTImageProcessor
+    - preprocess
+    - post_process_semantic_segmentation
+
 ## MobileViTModel
 
 [[autodoc]] MobileViTModel

docs/source/en/model_doc/perceiver.mdx

@@ -114,6 +114,11 @@ audio classification, video classification, etc.
 [[autodoc]] PerceiverFeatureExtractor
     - __call__
 
+## PerceiverImageProcessor
+
+[[autodoc]] PerceiverImageProcessor
+    - preprocess
+
 ## PerceiverTextPreprocessor
 
 [[autodoc]] models.perceiver.modeling_perceiver.PerceiverTextPreprocessor

docs/source/en/model_doc/poolformer.mdx

@@ -50,6 +50,11 @@ This model was contributed by [heytanay](https://huggingface.co/heytanay). The o
 [[autodoc]] PoolFormerFeatureExtractor
     - __call__
 
+## PoolFormerImageProcessor
+
+[[autodoc]] PoolFormerImageProcessor
+    - preprocess
+
 ## PoolFormerModel
 
 [[autodoc]] PoolFormerModel

docs/source/en/model_doc/segformer.mdx

@@ -95,6 +95,12 @@ SegFormer's results on the segmentation datasets like ADE20k, refer to the [pape
     - __call__
     - post_process_semantic_segmentation
 
+## SegformerImageProcessor
+
+[[autodoc]] SegformerImageProcessor
+    - preprocess
+    - post_process_semantic_segmentation
+
 ## SegformerModel
 
 [[autodoc]] SegformerModel

docs/source/en/model_doc/videomae.mdx

@@ -44,6 +44,11 @@ The original code can be found [here](https://github.com/MCG-NJU/VideoMAE).
 [[autodoc]] VideoMAEFeatureExtractor
     - __call__
 
+## VideoMAEImageProcessor
+
+[[autodoc]] VideoMAEImageProcessor
+    - preprocess
+
 ## VideoMAEModel
 
 [[autodoc]] VideoMAEModel