• Sayak Paul's avatar
    [Feat] PixArt-Alpha (#5642) · d61889fc
    Sayak Paul authored
    
    
    * init pixart alpha pipeline
    
    * fix: import
    
    * script
    
    * script
    
    * script
    
    * add: vae to the pipeline
    
    * add: vae_scale_factor
    
    * add: checkpoint_path
    
    * clean conversion script a bit.
    
    * size embeddings.
    
    * fix: size embedding
    
    * update scrip
    
    * support for interpolation of position embedding.
    
    * support for conditioning.
    
    * ..
    
    * ..
    
    * ..
    
    * final layer
    
    * final layer
    
    * align if encode_prompt
    
    * support for caption embedding
    
    * refactor
    
    * refactor
    
    * refactor
    
    * start cross attention
    
    * start cross attention
    
    * cross_attention_dim
    
    * cross
    
    * cross
    
    * support for resolution and aspect_ratio
    
    * support for caption projection
    
    * refactor patch embeddings
    
    * batch_size
    
    * up
    
    * commit
    
    * commit
    
    * commit.
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze
    
    * squeeze.
    
    * squeeze.
    
    * fix final block./
    
    * fix final block./
    
    * fix final block./
    
    * clean
    
    * fix: interpolation scale.
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging'
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * make --checkpoint_path non-required.
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * remove num_tokens
    
    * timesteps -> timestep
    
    * timesteps -> timestep
    
    * timesteps -> timestep
    
    * timesteps -> timestep
    
    * timesteps -> timestep
    
    * timesteps -> timestep
    
    * debug
    
    * debug
    
    * update conversion script.
    
    * update conversion script.
    
    * update conversion script.
    
    * debug
    
    * debug
    
    * debug
    
    * clean
    
    * debug
    
    * debug
    
    * debug
    
    * debug
    
    * debug
    
    * debug
    
    * debug
    
    * debug
    
    * deug
    
    * debug
    
    * debug
    
    * debug
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * fix
    
    * clean
    
    * fix
    
    * fix
    
    * boom
    
    * boom
    
    * some changes
    
    * boom
    
    * save
    
    * up
    
    * remove i
    
    * fix more tests
    
    * DPMSolverMultistepScheduler
    
    * fix
    
    * offloading
    
    * fix conversion script
    
    * fix conversion script
    
    * remove print
    
    * remove support for negative prompt embeds.
    
    * typo.
    
    * remove extra kwargs
    
    * bring conversion script to where it was
    
    * fix
    
    * trying mu luck
    
    * trying my luck again
    
    * again
    
    * again
    
    * again
    
    * clean up
    
    * up
    
    * up
    
    * update example
    
    * support for 512
    
    * remove spacing
    
    * finalize docs.
    
    * test debug
    
    * fix: assertion values.
    
    * debug
    
    * debug
    
    * debug
    
    * fix: repeat
    
    * remove prints.
    
    * Apply suggestions from code review
    
    * Apply suggestions from code review
    
    * Correct more
    
    * Apply suggestions from code review
    
    * Change all
    
    * Clean more
    
    * fix more
    
    * Fix more
    
    * Fix more
    
    * Correct more
    
    * address patrick's comments.
    
    * remove unneeded args
    
    * clean up pipeline.
    
    * sty;e
    
    * make the use of additional conditions better conditioned.
    
    * None better
    
    * dtype
    
    * height and width validation
    
    * add a note about size brackets.
    
    * fix
    
    * spit out slow test outputs.
    
    * fix?
    
    * fix optional test
    
    * fix more
    
    * remove unneeded comment
    
    * debug
    
    ---------
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    d61889fc
attention.py 17.3 KB