• Pablo Montalvo's avatar
    Fuyu: improve image processing (#27007) · 8a312956
    Pablo Montalvo authored
    
    
    * Fix Fuyu image scaling bug
    
    It could produce negative padding and hence inference errors for certain
    image sizes.
    
    * initial rework commit
    
    * add batching capabilities, refactor image processing
    
    * add functional batching for a list of images and texts
    
    * make args explicit
    
    * Fuyu processing update (#27133)
    
    * Add file headers
    
    * Add file headers
    
    * First pass - preprocess method with standard args
    
    * First pass image processor rework
    
    * Small tweaks
    
    * More args and docstrings
    
    * Tidying iterating over batch
    
    * Tidying up
    
    * Modify to have quick tests (for now)
    
    * Fix up
    
    * BatchFeature
    
    * Passing tests
    
    * Add tests for processor
    
    * Sense check when patchifying
    
    * Add some tests
    
    * FuyuBatchFeature
    
    * Post-process box coordinates
    
    * Update to `size` in processor
    
    * Remove unused and duplicate constants
    
    * Store unpadded dims after resize
    
    * Fix up
    
    * Return FuyuBatchFeature
    
    * Get unpadded sizes after resize
    
    * Update exception
    
    * Fix return
    
    * Convert input `<box>` coordinates to model format.
    
    * Post-process point coords, support multiple boxes/points in a single
    sequence
    
    * Replace constants
    
    * Update src/transformers/models/fuyu/image_processing_fuyu.py
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    
    * Preprocess List[List[image]]
    
    * Update src/transformers/models/fuyu/image_processing_fuyu.py
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    
    * Update to Amy's latest state.
    
    * post-processing returns a list of tensors
    
    * Fix error when target_sizes is None
    Co-authored-by: default avatarPablo Montalvo <pablo.montalvo.leroux@gmail.com>
    
    * Update src/transformers/models/fuyu/image_processing_fuyu.py
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    
    * Update src/transformers/models/fuyu/image_processing_fuyu.py
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    
    * Update src/transformers/models/fuyu/image_processing_fuyu.py
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    
    * Update src/transformers/models/fuyu/image_processing_fuyu.py
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    
    * Review comments
    
    * Update src/transformers/models/fuyu/image_processing_fuyu.py
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    
    * Fix up
    
    * Fix up
    
    ---------
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-72-126.ec2.internal>
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    Co-authored-by: default avatarPablo Montalvo <pablo.montalvo.leroux@gmail.com>
    
    * Fix conflicts in fuyu_follow_up_image_processing (#27228)
    
    fixing conflicts and updating on main
    
    * Revert "Fix conflicts in fuyu_follow_up_image_processing" (#27232)
    
    Revert "Fix conflicts in fuyu_follow_up_image_processing (#27228)"
    
    This reverts commit acce10b6c653dc7041fb9d18cfed55775afd6207.
    
    ---------
    Co-authored-by: default avatarPedro Cuenca <pedro@huggingface.co>
    Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-72-126.ec2.internal>
    8a312956
modeling_fuyu.py 15.1 KB