• NielsRogge's avatar
    Add ZoeDepth (#30136) · 06fd7972
    NielsRogge authored
    
    
    * First draft
    
    * Add docs
    
    * Clean up code
    
    * Convert model
    
    * Add image processor
    
    * Convert Zoe_K
    
    * More improvements
    
    * Improve variable names and docstrings
    
    * Improve variable names
    
    * Improve variable names
    
    * Replace nn.sequential
    
    * More improvements
    
    * Convert ZoeD_NK
    
    * Fix most tests
    
    * Verify pixel values
    
    * Verify pixel values
    
    * Add squeeze
    
    * Update beit to support arbitrary window sizes
    
    * Improve image processor
    
    * Improve docstring
    
    * Improve beit
    
    * Improve model outputs
    
    * Add figure
    
    * Fix beit
    
    * Update checkpoint
    
    * Fix repo id
    
    * Add _keys_to_ignore_on_load_unexpected
    
    * More improvements
    
    * Address comments
    
    * Address comments
    
    * Address comments
    
    * Address comments
    
    * Rename variable name
    
    * Add backbone_hidden_size
    
    * Vectorize
    
    * Vectorize more
    
    * Address comments
    
    * Clarify docstring
    
    * Remove backbone_hidden_size
    
    * Fix image processor
    
    * Remove print statements
    
    * Remove print statement
    
    * Add integration test
    
    * Address comments
    
    * Address comments
    
    * Address comments
    
    * Address comments
    
    * Add requires_backends
    
    * Clean up
    
    * Simplify conversion script
    
    * Simplify more
    
    * Simplify more
    
    * Simplify more
    
    * Clean up
    
    * Make sure beit is loaded correctly
    
    * Address comment
    
    * Address bin_configurations
    
    * Use bin_configurations
    
    * Convert models, add integration tests
    
    * Fix doc test
    
    * Address comments
    
    * Unify regressor classes
    
    * Clarify arguments
    
    * Improve resize_image
    
    * Add num_relative_features
    
    * Address comment
    
    * [run-slow]beit,data2vec,zoedepth
    
    * [run-slow]beit,data2vec,zoedepth
    
    * Address comments
    
    * Address comment
    
    * Address comment
    
    * Replace nn.TransformerEncoderLayer and nn.TransformerEncoder
    
    * Replace nn.MultiheadAttention
    
    * Add attributes for patch transformer to config
    
    * Add tests for ensure_multiple_of
    
    * Update organization
    
    * Add tests
    
    * [run-slow] beit data2vec
    
    * Update ruff
    
    * [run-slow] beit data2vec
    
    * Add comment
    
    * Improve docstrings, add test
    
    * Fix interpolate_pos_encoding
    
    * Fix slow tests
    
    * Add docstring
    
    * Update src/transformers/models/zoedepth/image_processing_zoedepth.py
    Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
    
    * Update src/transformers/models/zoedepth/image_processing_zoedepth.py
    Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
    
    * Improve tests and docstrings
    
    * Use run_common_tests
    
    * Improve docstrings
    
    * Improve docstrings
    
    * Improve tests
    
    * Improve tests
    
    * Remove print statements
    
    ---------
    Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
    06fd7972
modeling_beit.py 64.9 KB