GitLab

A default of 1 all the times is bad for TPU users which end up not using the device effectively.
A larger default all the times is bad for GPU users.

So compromise and make this dependent on the devices available.

PiperOrigin-RevId: 312230371