DEV Community

Cover image for Deploying Hugging Face models on Amazon SageMaker using infrastructure as code
aaronkao for Pulumi

Posted on

Deploying Hugging Face models on Amazon SageMaker using infrastructure as code

Here is a quick template and tutorial for bootstrapping Amazon SageMaker to run a LlaMa 2 model from Hugging Face. Everything is deployed as code (Python); no manual tweaking in the SageMaker console.

www.pulumi.com/blog/mlops-huggingface-llm-aws-sagemaker-python/

Top comments (0)