Add note about --no-build-isolation flag in readme (#6427)

README.rst

@@ -89,6 +89,8 @@ From source:
     # MACOSX_DEPLOYMENT_TARGET=10.9 CC=clang CXX=clang++ python setup.py install
 
 
+We don't officially support building from source using ``pip``, but *if* you do,
+you'll need to use the ``--no-build-isolation`` flag.
 In case building TorchVision from source fails, install the nightly version of PyTorch following
 the linked guide on the  `contributing page <https://github.com/pytorch/vision/blob/main/CONTRIBUTING.md#development-installation>`_ and retry the install.