• Suraj Patil's avatar
    Textual inversion (#266) · d0d3e24e
    Suraj Patil authored
    * add textual inversion script
    
    * make the loop work
    
    * make coarse_loss optional
    
    * save pipeline after training
    
    * add arg pretrained_model_name_or_path
    
    * fix saving
    
    * fix gradient_accumulation_steps
    
    * style
    
    * fix progress bar steps
    
    * scale lr
    
    * add argument to accept style
    
    * remove unused args
    
    * scale lr using num gpus
    
    * load tokenizer using args
    
    * add checks when converting init token to id
    
    * improve commnets and style
    
    * document args
    
    * more cleanup
    
    * fix default adamw arsg
    
    * TextualInversionWrapper -> CLIPTextualInversionWrapper
    
    * fix tokenizer loading
    
    * Use the CLIPTextModel instead of wrapper
    
    * clean dataset
    
    * remove commented code
    
    * fix accessing grads for multi-gpu
    
    * more cleanup
    
    * fix saving on multi-GPU
    
    * init_placeholder_token_embeds
    
    * add seed
    
    * fix flip
    
    * fix multi-gpu
    
    * add utility methods in wrapper
    
    * remove ipynb
    
    * don't use wrapper
    
    * dont pass vae an dunet to accelerate prepare
    
    * bring back accelerator.accumulate
    
    * scale latents
    
    * use only one progress bar for steps
    
    * push_to_hub at the end of training
    
    * remove unused args
    
    * log some important stats
    
    * store args in tensorboard
    
    * pretty comments
    
    * save the trained embeddings
    
    * mobe the script up
    
    * add requirements file
    
    * more cleanup
    
    * fux typo
    
    * begin readme
    
    * style -> learnable_property
    
    * keep vae and unet in eval mode
    
    * address review comments
    
    * address more comments
    
    * removed unused args
    
    * add train command in readme
    
    * update readme
    d0d3e24e
README.md 2.85 KB