Posted on • Originally published at julsimon.Medium on
In this video, I walk you through the simple process of deploying a Llama 3 8B model with Amazon SageMaker.
I use the latest version of the Text Generation Inference containers (TGI 2.0), and show you how to run synchronous inference and streaming inference.
For further actions, you may consider blocking this person and/or reporting abuse
Saumya -
vaatiesther -
Qyrus -
Vinod Kumar -
Top comments (0)