Unverified Commit 27916822 authored by Juan Acevedo's avatar Juan Acevedo Committed by GitHub
Browse files

update readme instructions. (#11096)


Co-authored-by: default avatarJuan Acevedo <jfacevedo@google.com>
parent 3fe3bc06
# Generating images using Flux and PyTorch/XLA # Generating images using Flux and PyTorch/XLA
The `flux_inference` script shows how to do image generation using Flux on TPU devices using PyTorch/XLA. It uses the pallas kernel for flash attention for faster generation. The `flux_inference` script shows how to do image generation using Flux on TPU devices using PyTorch/XLA. It uses the pallas kernel for flash attention for faster generation using custom flash block sizes for better performance on [Trillium](https://cloud.google.com/blog/products/compute/introducing-trillium-6th-gen-tpus) TPU versions. No other TPU types have been tested.
It has been tested on [Trillium](https://cloud.google.com/blog/products/compute/introducing-trillium-6th-gen-tpus) TPU versions. No other TPU types have been tested.
## Create TPU ## Create TPU
...@@ -23,20 +21,23 @@ Verify that PyTorch and PyTorch/XLA were installed correctly: ...@@ -23,20 +21,23 @@ Verify that PyTorch and PyTorch/XLA were installed correctly:
python3 -c "import torch; import torch_xla;" python3 -c "import torch; import torch_xla;"
``` ```
Install dependencies Clone the diffusers repo and install dependencies
```bash ```bash
git clone https://github.com/huggingface/diffusers.git
cd diffusers
pip install transformers accelerate sentencepiece structlog pip install transformers accelerate sentencepiece structlog
pushd ../../..
pip install . pip install .
popd cd examples/research_projects/pytorch_xla/inference/flux/
``` ```
## Run the inference job ## Run the inference job
### Authenticate ### Authenticate
Run the following command to authenticate your token in order to download Flux weights. **Gated Model**
As the model is gated, before using it with diffusers you first need to go to the [FLUX.1 [dev] Hugging Face page](https://huggingface.co/black-forest-labs/FLUX.1-dev), fill in the form and accept the gate. Once you are in, you need to log in so that your system knows you’ve accepted the gate. Use the command below to log in:
```bash ```bash
huggingface-cli login huggingface-cli login
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment