• NielsRogge's avatar
    Add Deformable DETR (#17281) · 59407bbe
    NielsRogge authored
    
    
    * First draft
    
    * More improvements
    
    * Improve model, add custom CUDA code
    
    * Import torch before
    
    * Add script that imports custom layer
    
    * Add everything in new ops directory
    
    * Import custom layer in modeling file
    
    * Fix ARCHIVE_MAP typo
    
    * Creating the custom kernel on the fly.
    
    * Import custom layer in modeling file
    
    * More improvements
    
    * Fix CUDA loading
    
    * More improvements
    
    * Improve conversion script
    
    * Improve conversion script
    
    * Make it work until encoder_outputs
    
    * Make forward pass work
    
    * More improvements
    
    * Make logits match original implementation
    
    * Make implementation also support single_scale model
    
    * Add support for single_scale and dilation checkpoint
    
    * Add support for with_box_refine model
    
    * Support also two stage model
    
    * Improve tests
    
    * Fix more tests
    
    * Make more tests pass
    
    * Upload all models to the hub
    
    * Clean up some code
    
    * Improve decoder outputs
    
    * Rename intermediate hidden states and reference points
    
    * Improve model outputs
    
    * Move tests to dedicated folder
    
    * Improve model outputs
    
    * Fix retain_grad test
    
    * Improve docs
    
    * Clean up and make test_initialization pass
    
    * Improve variable names
    
    * Add copied from statements
    
    * Improve docs
    
    * Fix style
    
    * Improve docs
    
    * Improve docs, move tests to model folder
    
    * Fix rebase
    
    * Remove DetrForSegmentation from auto mapping
    
    * Apply suggestions from code review
    
    * Improve variable names and docstrings
    
    * Apply some more suggestions from code review
    
    * Apply suggestion from code review
    
    * better docs and variables names
    
    * hint to num_queries and two_stage confusion
    
    * remove asserts and code refactor
    
    * add exception if two_stage is True and with_box_refine is False
    
    * use f-strings
    
    * Improve docs and variable names
    
    * Fix code quality
    
    * Fix rebase
    
    * Add require_torch_gpu decorator
    
    * Add pip install ninja to CI jobs
    
    * Apply suggestion of @sgugger
    
    * Remove DeformableDetrForObjectDetection from auto mapping
    
    * Remove DeformableDetrModel from auto mapping
    
    * Add model to toctree
    
    * Add model back to mappings, skip model in pipeline tests
    
    * Apply @sgugger's suggestion
    
    * Fix imports in the init
    
    * Fix copies
    
    * Add CPU implementation
    
    * Comment out GPU function
    
    * Undo previous change
    
    * Apply more suggestions
    
    * Remove require_torch_gpu annotator
    
    * Fix quality
    
    * Add logger.info
    
    * Fix logger
    
    * Fix variable names
    
    * Fix initializaztion
    
    * Add missing initialization
    
    * Update checkpoint name
    
    * Add model to doc tests
    
    * Add CPU/GPU equivalence test
    
    * Add Deformable DETR to pipeline tests
    
    * Skip model for object detection pipeline
    Co-authored-by: default avatarNicolas Patry <patry.nicolas@protonmail.com>
    Co-authored-by: default avatarNouamane Tazi <nouamane98@gmail.com>
    Co-authored-by: default avatarSylvain Gugger <Sylvain.gugger@gmail.com>
    59407bbe
index.mdx 58.7 KB