The latest articles on DEV Community by olaf w (@olaf__99a56105ff7109). https://dev.to/olaf__99a56105ff7109 https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4046549%2F8a7830e3-3441-4da7-b07c-69292d9239e8.png https://dev.to/olaf__99a56105ff7109 en olaf w Sat, 25 Jul 2026 08:02:43 +0000 https://dev.to/olaf__99a56105ff7109/deploying-hugging-face-models-to-nvidia-triton-on-kubernetes-end-to-end-walkthrough-12ie https://dev.to/olaf__99a56105ff7109/deploying-hugging-face-models-to-nvidia-triton-on-kubernetes-end-to-end-walkthrough-12ie <p>I’ve been working on Triton Control, an open-source project that simplifies deploying models to NVIDIA Triton Inference Server.</p> <p>This article walks through two complete workflows:</p> <ul> <li>Deploying an existing Triton model repository</li> <li>Converting a Hugging Face DistilBERT model to TorchScript and serving it with Triton</li> </ul> <p>It covers S3-backed model repositories, Kubernetes deployment, GPU inference, and endpoint testing.</p> <p>I’m particularly interested in feedback on the architecture and deployment workflow.</p> <p>Article: <a href="https://medium.com/@owilken/from-model-to-inference-endpoint-with-nvidia-triton-and-triton-control-7636439a8f28" rel="noopener noreferrer">https://medium.com/@owilken/from-model-to-inference-endpoint-with-nvidia-triton-and-triton-control-7636439a8f28</a></p> <p>GitHub: <a href="https://github.com/ai-lab-tech/triton-control" rel="noopener noreferrer">https://github.com/ai-lab-tech/triton-control</a></p> ai devops kubernetes