• Aryan's avatar
    Cosmos (#10660) · 7b904941
    Aryan authored
    
    
    * begin transformer conversion
    
    * refactor
    
    * refactor
    
    * refactor
    
    * refactor
    
    * refactor
    
    * refactor
    
    * update
    
    * add conversion script
    
    * add pipeline
    
    * make fix-copies
    
    * remove einops
    
    * update docs
    
    * gradient checkpointing
    
    * add transformer test
    
    * update
    
    * debug
    
    * remove prints
    
    * match sigmas
    
    * add vae pt. 1
    
    * finish CV* vae
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * make fix-copies
    
    * update
    
    * make fix-copies
    
    * fix
    
    * update
    
    * update
    
    * make fix-copies
    
    * update
    
    * update tests
    
    * handle device and dtype for safety checker; required in latest diffusers
    
    * remove enable_gqa and use repeat_interleave instead
    
    * enforce safety checker; use dummy checker in fast tests
    
    * add review suggestion for ONNX export
    Co-Authored-By: default avatarAsfiya Baig <asfiyab@nvidia.com>
    
    * fix safety_checker issues when not passed explicitly
    
    We could either do what's done in this commit, or update the Cosmos examples to explicitly pass the safety checker
    
    * use cosmos guardrail package
    
    * auto format docs
    
    * update conversion script to support 14B models
    
    * update name CosmosPipeline -> CosmosTextToWorldPipeline
    
    * update docs
    
    * fix docs
    
    * fix group offload test failing for vae
    
    ---------
    Co-authored-by: default avatarAsfiya Baig <asfiyab@nvidia.com>
    7b904941
__init__.py 31.7 KB