Deploying Hugging Face models on Amazon SageMaker using infrastructure as code

Deploying Hugging Face models on Amazon SageMaker using infrastructure as code

aaronkao - Sep 19 '23 -

- Dev Community

Here is a quick template and tutorial for bootstrapping Amazon SageMaker to run a LlaMa 2 model from Hugging Face. Everything is deployed as code (Python); no manual tweaking in the SageMaker console.

www.pulumi.com/blog/mlops-huggingface-llm-aws-sagemaker-python/

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Terabox Video Player