• NielsRogge's avatar
    Add CLIPSeg (#20066) · 25896306
    NielsRogge authored
    
    
    * Add first draft
    
    * Update conversion script
    
    * Improve conversion script
    
    * Improve conversion script some more
    
    * Add conditional embeddings
    
    * Add initial decoder
    
    * Fix activation function of decoder
    
    * Make decoder outputs match original implementation
    
    * Make decoder outputs match original implementation
    
    * Add more copied from statements
    
    * Improve model outputs
    
    * Fix auto tokenizer file
    
    * Fix more tests
    
    * Add test
    
    * Improve README and docs, improve conditional embeddings
    
    * Fix more tests
    
    * Remove print statements
    
    * Remove initial embeddings
    
    * Improve conversion script
    
    * Add interpolation of position embeddings
    
    * Finish addition of interpolation of position embeddings
    
    * Add support for refined checkpoint
    
    * Fix refined checkpoint
    
    * Remove unused parameter
    
    * Improve conversion script
    
    * Add support for training
    
    * Fix conversion script
    
    * Add CLIPSegFeatureExtractor
    
    * Fix processor
    
    * Fix CLIPSegProcessor
    
    * Fix conversion script
    
    * Fix most tests
    
    * Fix equivalence test
    
    * Fix README
    
    * Add model to doc tests
    
    * Use better variable name
    
    * Convert other checkpoint as well
    
    * Update config, add link to paper
    
    * Add docs
    
    * Update organization
    
    * Replace base_model_prefix with clip
    
    * Fix base_model_prefix
    
    * Fix checkpoint of config
    
    * Fix config checkpoint
    
    * Remove file
    
    * Use logits for output
    
    * Fix tests
    Co-authored-by: default avatarNiels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
    25896306
clipseg.mdx 3.63 KB