@@ -83,7 +83,7 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
...
@@ -83,7 +83,7 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
> [!Caution]
> [!Caution]
> ¹ There is a known issue with the TensorRT-LLM framework when installed within the AL2023 container via the Python Wheels which makes effective environment setup challenging.
> ¹ There is a known issue with the TensorRT-LLM framework when running the AL2023 container locally with `docker run --network host ...` due to a [bug](https://github.com/mpi4py/mpi4py/discussions/491#discussioncomment-12660609) in mpi4py. To avoid this issue, replace the `--network host` flag with more precise networking configuration by mapping only the necessary ports (e.g., 4222 for nats, 2379/2380 for etcd, 8080 for frontend).