The latest articles on DEV Community by Kenneth Bingham (@qrkourier). https://dev.to/qrkourier https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3665132%2Fc6c9a43c-8d87-4024-ab62-1deef58f8ce8.jpeg https://dev.to/qrkourier en Kenneth Bingham Tue, 16 Dec 2025 14:38:14 +0000 https://dev.to/qrkourier/deploying-a-secure-intelligent-llm-gateway-3h5n https://dev.to/qrkourier/deploying-a-secure-intelligent-llm-gateway-3h5n <p>For serving LLMs with respect to cost, privacy, and compliance controls, I've been playing with ideas for diverting relevant prompts to specialized or private model(s) and handling the rest with a cost-controlled frontier model.</p> <p>Read <a href="https://netfoundry.io/ai/deploying-a-secure-intelligent-llm-gateway" rel="noopener noreferrer">the blog post</a> or skip directly to <a href="https://github.com/openziti-test-kitchen/litellm-gateway-demo?tab=readme-ov-file#readme" rel="noopener noreferrer">the demo recipe in GitHub</a>.</p> ai llm netfoundry openziti