installation_inferentia.md 183 Bytes
Newer Older
xuxzh1's avatar
last  
xuxzh1 committed
1
2
3
# Using TGI with Inferentia

Check out this [guide](https://github.com/huggingface/optimum-neuron/tree/main/text-generation-inference) on how to serve models with TGI on Inferentia2.