"Failed to place model onto specified device. This may be because the model is quantized via `bitsandbytes`. If the desired GPU is being used, this message is safe to ignore."
"Failed to place model onto specified device. This may be because the model is quantized via `bitsandbytes`. If the desired GPU is being used, this message is safe to ignore."
)
)
else:
else:
assertaccelerator.distributed_typein[DistributedType.FSDP,DistributedType.MULTI_GPU],"Unsupported distributed type provided. Only DDP and FSDP are supported."
assertaccelerator.distributed_typein[
DistributedType.FSDP,
DistributedType.MULTI_GPU
],"Unsupported distributed type provided. Only DDP and FSDP are supported."