installation_inferentia.md 183 Bytes
Newer Older
fxmarty's avatar
fxmarty committed
1
2
3
# Using TGI with Inferentia

Check out this [guide](https://github.com/huggingface/optimum-neuron/tree/main/text-generation-inference) on how to serve models with TGI on Inferentia2.