DEV Community: Soren Lindqvist

8 Best AI Gateways for EU AI Act and Data Residency Requirements

Soren Lindqvist — Thu, 23 Jul 2026 21:57:42 +0000

As the EU AI Act's enforcement deadline approaches, choosing an AI gateway with robust data residency and governance features is critical. This guide compares the top 8 gateways, with a detailed look at how Bifrost provides the most comprehensive solution for enterprises needing to comply with European regulations.

The EU AI Act, with its high-risk system provisions taking full effect on August 2, 2026, has transformed AI compliance from a legal checklist into a core engineering challenge. For organizations operating in Europe, data residency and governance are no longer optional. The Act, in conjunction with GDPR, requires strict controls over data processing, model transparency, and risk management. Fines for non-compliance can reach up to 35 million euros or 7% of global annual turnover, making the choice of infrastructure a critical business decision.

An AI gateway is the central control plane for managing this complexity. It sits between your applications and various large language model (LLM) providers, enforcing policies, managing data flows, and ensuring that all AI traffic adheres to regulatory requirements. A gateway built for the EU market must provide verifiable data residency, ensuring that data processing occurs within EU borders and that cross-border transfers are meticulously controlled.

This guide evaluates the top AI gateways available in 2026, focusing on their ability to meet the stringent data residency and governance demands of the EU AI Act.

Key Criteria for an EU-Compliant AI Gateway

When evaluating AI gateways for EU operations, platform teams should look for specific, verifiable features:

Verifiable EU Data Residency: The gateway's infrastructure must be hosted in the EU, and it must guarantee that requests are processed and logged within the region. A simple "EU endpoint" is insufficient; teams must verify where inference actually runs.
Deployment Flexibility: The ability to deploy the gateway within a Virtual Private Cloud (VPC), on-premises, or in an air-gapped environment is crucial for organizations in regulated industries like finance and healthcare.
Comprehensive Audit Logs: The EU AI Act mandates detailed record-keeping for high-risk systems. The gateway must produce immutable, audit-grade logs for every request, response, and policy decision.
Data Governance and Guardrails: Features like PII redaction, role-based access control (RBAC), and integration with content safety tools are essential for protecting data and preventing misuse.
Provider-Agnostic Routing: The gateway should be able to route traffic to EU-hosted endpoints of major model providers (like AWS Bedrock, Azure OpenAI, and Google Vertex AI) to maintain end-to-end data residency.

The Top 8 AI Gateways for EU Compliance

Here is an assessment of the leading AI gateways, ranked based on their suitability for EU AI Act and data residency requirements.

1. Bifrost

Best for: Enterprises in regulated industries requiring verifiable data residency, high performance, and comprehensive governance.

Bifrost, the open-source AI gateway from Maxim AI, is engineered for the complex compliance landscape of the EU. Its key differentiator is its deployment flexibility. Bifrost can be deployed entirely within a customer's own EU-based VPC or on-premises infrastructure, providing absolute control over data flows and ensuring that no data leaves the jurisdiction.

For regulated industries like finance and healthcare, this eliminates the compliance ambiguity associated with third-party SaaS gateways. Bifrost's enterprise version builds on its open-source foundation with features directly mapped to the EU AI Act's requirements, including immutable audit logs for traceability, role-based access control (RBAC), and guardrails for content safety and PII redaction. Its ability to function as a sophisticated MCP gateway further allows for governed, auditable AI agentic workflows, a key concern for high-risk systems.

2. Kong AI Gateway

Best for: Organizations already invested in the Kong ecosystem that require self-hosted, on-premises control.

Kong AI Gateway extends its mature API management platform with AI-specific capabilities. Like Bifrost, its primary strength for EU compliance is its self-hosting option, which allows enterprises to deploy it on their own EU infrastructure for full data sovereignty. Kong provides robust security features, including audit logs and options to customize logging to protect sensitive data for GDPR. It also offers plugins for tasks like PII sanitization, which can be configured to redact sensitive information before it reaches upstream models. While it offers strong foundational components for compliance, achieving the full suite of AI-specific governance may require more configuration compared to purpose-built solutions.

3. LiteLLM

Best for: Teams with strong DevOps expertise who need an open-source, highly customizable solution and can manage the operational overhead.

LiteLLM is a popular open-source proxy that unifies access to over 100 LLM providers through an OpenAI-compatible API. Its open-source nature means it can be self-hosted anywhere, including within EU data centers, giving teams complete control over data residency. LiteLLM provides essential features like virtual key management, budget tracking, and basic fallbacks. However, production-grade deployment for compliance requires significant engineering effort to set up and maintain the necessary observability, logging, and security infrastructure, which can increase the total cost of ownership. An enterprise tier is available that adds features like SSO and audit logs.

4. Eden AI

Best for: European teams looking for a SaaS gateway with native GDPR compliance and EU-based infrastructure.

Eden AI is a strong SaaS choice for European teams. Headquartered in France and running on EU infrastructure by default, it simplifies GDPR compliance. Its platform provides a unified API to numerous AI providers and, crucially, allows users to filter routing to only use GDPR-compliant providers and EU-hosted models. This helps prevent accidental data transfers outside the EU. As a SaaS solution, it offers less control than self-hosted options like Bifrost or Kong, but for teams that prioritize ease of use and a clear EU-native posture, it is a compelling option.

5. Requesty

Best for: Teams needing a straightforward, EU-hosted routing layer with zero data retention.

Requesty is a purpose-built EU AI gateway hosted in Frankfurt, Germany. It focuses on providing a simple, compliant routing layer with a strict zero data retention policy for prompts and responses. It offers an OpenAI-compatible API to route requests to the EU-region deployments of major providers like Anthropic (via AWS Bedrock), Google, and Azure OpenAI. While it may not have the extensive governance features of Bifrost or Kong, its clear and verifiable EU residency makes it an excellent choice for applications whose primary requirement is keeping all AI traffic within the EU.

6. OpenRouter

Best for: Enterprises that need access to a wide variety of models and can use the dedicated EU endpoint.

OpenRouter provides a unified API to a vast catalog of models. By default, its infrastructure is US-based, but it offers a dedicated eu.openrouter.ai endpoint for enterprise customers that ensures prompts and completions are processed entirely within the EU. OpenRouter also has strong privacy controls, including options to enforce Zero Data Retention (ZDR) and to block providers that train on user data. However, the EU-specific routing is an enterprise feature, meaning smaller teams using the standard plans will not have the same residency guarantees.

7. Cloudflare AI Gateway

Best for: Teams already using Cloudflare who need basic logging, caching, and analytics.

Cloudflare AI Gateway integrates AI routing into its global edge network. It provides valuable features like caching, rate limiting, and analytics for cost and usage. However, its data residency capabilities are not as mature. As of mid-2026, the gateway does not offer controls to pin data processing or caching to specific regions like the EU. While logs can be managed through the Customer Metadata Boundary, the inference itself happens on global GPU clusters with no specific geographic guarantee, making it unsuitable for workloads with strict data residency requirements.

8. TrueFoundry

Best for: Enterprises seeking a managed platform that can be deployed in a dedicated EU cloud environment.

TrueFoundry offers an AI gateway that can be deployed within a customer's VPC, providing a strong data residency story. It is designed to enforce residency end-to-end, including region-locked inference routing and local audit logs. The platform includes a suite of governance and observability features aimed at enterprise use cases. While it offers a powerful set of capabilities, it is part of a broader platform, which may be more than is needed for teams just looking for a standalone gateway.

How to Choose the Right Gateway

The best AI gateway for your organization depends on your specific regulatory needs, operational capabilities, and existing infrastructure.

Gateway	Deployment Model	Key EU Compliance Feature	Best For
Bifrost	Self-Hosted (VPC, On-Prem, Air-Gapped)	Full infrastructure control, immutable audit logs, enterprise governance	Regulated enterprises
Kong AI Gateway	Self-Hosted (VPC, On-Prem)	Data sovereignty through self-hosting, mature security ecosystem	Existing Kong users
LiteLLM	Self-Hosted (VPC, On-Prem)	Open-source flexibility, complete infrastructure control	Teams with strong DevOps
Eden AI	SaaS	EU-native hosting and provider filtering	EU-based teams needing SaaS
Requesty	SaaS	Guaranteed EU-hosted routing and zero data retention	Simple EU data residency
OpenRouter	SaaS	Dedicated EU endpoint for enterprise, ZDR controls	Teams needing many models
Cloudflare AI Gateway	SaaS	Caching and analytics	Existing Cloudflare users
TrueFoundry	Managed (Customer VPC)	End-to-end regional enforcement	Enterprises needing a managed platform

Conclusion

With the EU AI Act's deadline approaching, treating compliance as an infrastructure problem is no longer optional. An AI gateway is the most effective tool for centralizing governance, ensuring data residency, and producing the audit trails required by regulators.

For enterprises in regulated sectors, self-hosted solutions like Bifrost and Kong AI Gateway offer the highest degree of control and verifiability. Bifrost, in particular, stands out for its combination of high-performance, open-source transparency, and an enterprise-grade feature set designed specifically for the security and compliance challenges of modern AI systems. For teams without the resources to self-host, SaaS options like Eden AI and Requesty provide a clear path to EU compliance.

Ultimately, the right choice will be the gateway that best aligns with your organization's technical expertise and risk posture. Teams evaluating these options should request a Bifrost demo or review the open-source repository to see how a dedicated AI gateway can enforce compliance by design.

Sources

Enterprise AI in 2026: A Buyer's Guide for Decision-Makers

Soren Lindqvist — Tue, 14 Jul 2026 15:11:56 +0000

As AI moves beyond pilots into core operations, enterprise decision-makers face complex choices in infrastructure, governance, and quality. This guide helps navigate the strategic investments for scalable, secure, and reliable enterprise AI in 2026, highlighting foundational components like the Bifrost AI gateway.

In 2026, artificial intelligence is no longer an experimental technology; it is a fundamental component of enterprise operations. Organizations are shifting from isolated AI pilots to strategic, widespread integration, transforming everything from customer service and finance to software development and supply chains. However, this rapid adoption introduces significant challenges related to data quality, governance, security, and the reliable deployment of AI systems at scale. Decision-makers must now navigate a complex landscape to ensure their AI investments translate into measurable business value and sustainable transformation. A robust enterprise AI strategy requires careful consideration of core infrastructure, governance frameworks, and comprehensive quality assurance.

The Evolving Landscape of Enterprise AI

The enterprise AI landscape in 2026 is characterized by several pivotal trends. Sovereign AI investments are accelerating, driven by the need for greater control over data, models, and infrastructure, particularly in regulated industries like healthcare and financial services. Agentic AI, which moves beyond generative chatbots to autonomous task execution, is also seeing wide adoption, though with a strong emphasis on guardrails and human-in-the-loop controls. Additionally, embedded AI is becoming invisible infrastructure, integrating seamlessly into existing business applications.

Despite the clear benefits, many organizations struggle to scale AI beyond initial pilots. Common barriers include data integrity and trust deficits, a shortage of AI expertise, challenges in integrating with legacy systems, and privacy, security, and regulatory concerns. Studies indicate that nearly 80% of organizations face challenges in adopting AI, with many C-suite executives admitting their AI strategies are "more for show" than actual internal guidance. To bridge this gap, a structured approach to buying and implementing AI infrastructure is essential.

Core Pillars of Enterprise AI Infrastructure

For enterprises to move confidently from AI ambition to operational reality, foundational infrastructure must address performance, reliability, and governance. An AI gateway stands as a critical component, centralizing control over diverse AI models and providers.

Ensuring Reliability and Performance

Enterprise AI applications require infrastructure that can handle high throughput with minimal latency, provide seamless failover, and intelligently route requests. The costs associated with LLM usage can quickly escalate without proper controls. An AI gateway like Bifrost, an open-source AI gateway from Maxim AI, offers a unified API to over 1000 models, enabling automatic failover and intelligent load balancing across providers. Bifrost's reported overhead is as low as 11 microseconds per request at 5,000 requests per second in sustained benchmarks, critical for performance-sensitive workloads. Its semantic caching capabilities further reduce costs and latency for repeated queries by returning intelligently cached responses.

Robust AI Governance and Security

AI governance platforms are becoming non-negotiable for enterprises. Governance extends beyond policy documents; it requires technical enforcement at the infrastructure layer. An AI gateway provides a single control point for managing access, setting budgets, and enforcing rate limits at a token level, rather than just request counts. This allows for granular cost attribution and chargeback across teams and projects, crucial for financial accountability.

Bifrost offers advanced governance features such as virtual keys, which enable per-consumer access permissions, budgets, and rate limits. These controls allow organizations to define and enforce granular policies across all AI traffic. Furthermore, enterprise-grade features like role-based access control (RBAC), data access control (DAC), and immutable audit logs ensure compliance with regulations like GDPR, HIPAA, and SOC 2. Guardrails, including native secrets detection and custom regex patterns, as well as integrations with third-party solutions like AWS Bedrock Guardrails and Azure Content Safety, protect sensitive data in prompts and responses.

Mitigating Shadow AI and Gaining Endpoint Visibility

The proliferation of easily accessible AI tools has led to a significant "shadow AI" problem within enterprises. Employees often use unapproved generative AI tools, browser plugins, or coding agents without oversight from IT or security teams. This ungoverned usage creates critical security vulnerabilities, risks data leakage, and can lead to compliance violations. The risks associated with shadow AI breaches can add hundreds of thousands of dollars to incident costs.

Addressing shadow AI requires extending governance beyond the network perimeter to every endpoint. This is where Bifrost Edge plays a critical role. Bifrost, as the AI gateway, functions as the central control plane and policy engine. Bifrost Edge extends that same governance and security to AI traffic on employee machines, with endpoint enforcement on each device. It runs natively on macOS, Windows, and Linux, ensuring that all AI applications used by employees—desktop chat apps, AI in the browser, coding agents—route through the organization's Bifrost instance.

Bifrost Edge provides visibility into which AI applications and MCP servers are being used across the fleet, allowing administrators to approve or deny them centrally. This ensures that existing policies, virtual keys, budgets, and guardrails apply to all AI interactions, regardless of where they originate. Edge can be deployed fleet-wide through Mobile Device Management (MDM) platforms like Jamf, Microsoft Intune, and Kandji, simplifying rollout and ensuring consistent policy application without requiring per-app configuration from users. It is currently in alpha, offering early access to this crucial layer of endpoint governance.

The Imperative of AI Agent Evaluation and Observability

As agentic AI becomes more prevalent in enterprise workflows, the need for robust evaluation and observability solutions intensifies. These systems move beyond simple prompt-response interactions, often reasoning, planning, and executing multi-step tasks that involve external tools and data sources. Understanding and controlling these complex behaviors is paramount for ensuring reliability, safety, and compliance.

Establishing an Evaluation Framework

Traditional LLM evaluation focuses on text output accuracy; agent evaluation must go further, assessing full trajectories, tool use, and adherence to governance policies. Enterprises need to verify that agents perform reliably, safely, and cost-effectively across their intended tasks. This includes validating their logic, reasoning chains, and compliance with permission boundaries and approved data access.

Maxim AI offers an end-to-end platform for AI simulation and evaluation that helps teams ship AI agents reliably. Its simulation engine allows testing agents across hundreds of scenarios and user personas, observing how they respond at every step. The platform provides a unified framework for both machine and human evaluations, offering off-the-shelf evaluators or the ability to create custom, quantitative metrics. This capability is critical for validating agent behavior before deployment and ensuring they align with business objectives and regulatory requirements.

Real-time Observability in Production

Once AI agents are deployed, continuous observability becomes a governance requirement, not just a technical feature. AI systems are non-deterministic, and their behavior depends on a multitude of factors, making traditional monitoring insufficient. AI observability captures the signals behind every AI action—tracing workflows, decisions, and system interactions—to provide governance-grade visibility into how autonomous systems behave in production.

Maxim AI's observability suite provides real-time production monitoring with automated quality checks. It allows for tracking, debugging, and resolving live quality issues with alerts and distributed tracing across multiple applications. This level of visibility helps enterprises understand not just if a system failed, but why it chose a particular tool, how a response was generated, or where a failure occurred. Such insights are essential for debugging, threat detection, compliance enforcement, and continuous improvement of AI systems, turning AI from a black box into a manageable and accountable asset.

Key Considerations for Your AI Strategy

Decision-makers formulating their enterprise AI strategy for 2026 must prioritize several key areas:

Integrated Governance: Ensure that governance frameworks (like NIST AI RMF and ISO 42001) are not just documented policies but are operationalized through technical controls at the infrastructure layer.
Scalable Infrastructure: Invest in AI gateways that provide high performance, multi-provider support, and intelligent routing to manage costs and ensure reliability at scale.
Endpoint Security: Implement solutions like Bifrost Edge to mitigate shadow AI, gaining visibility and control over all AI usage on employee devices.
Continuous Quality Assurance: Adopt platforms like Maxim AI for comprehensive evaluation and observability, ensuring AI agents are tested rigorously before deployment and monitored continuously in production.
Cross-Functional Collaboration: Foster environments where engineering, product, and compliance teams can collaborate effectively on AI quality and governance.

The move from AI pilots to widespread enterprise transformation is defining 2026. Organizations that strategically invest in robust infrastructure and comprehensive quality assurance, underpinned by strong governance, will be best positioned to realize the full value of AI and navigate its complexities. Teams seeking to operationalize their AI governance program or enhance their AI agent quality can request a Bifrost demo for infrastructure and governance, or book a Maxim demo for evaluation and observability.

Sources

Spectro Cloud. "Enterprise AI trends in 2026: Sovereign, agentic, edge, AI factories." January 23, 2026.
HAProxy Technologies. "What are the benefits of using an AI gateway?" May 29, 2026.
Mimecast. "Shadow AI: the hidden threat quietly undermining your business." April 21, 2026.
Domo. "AI Agent Evaluation: What It Is and Why It Matters." July 06, 2026.
Kanerika. "12 AI Governance Best Practices for Enterprises in 2026." July 06, 2026.

Best Tools to Discover Unsanctioned AI Apps on Employee Devices

Soren Lindqvist — Thu, 09 Jul 2026 10:01:58 +0000

Unsanctioned AI tools on employee devices pose significant data security and compliance risks. This post explores effective shadow AI discovery tools, focusing on how Bifrost and Bifrost Edge provide comprehensive endpoint AI governance to identify and manage these applications.

The rapid adoption of AI tools by employees, often outside of IT oversight, has created a significant challenge for enterprises: "shadow AI." This phenomenon refers to the unauthorized use of AI applications, models, agents, or services within an organization, leading to substantial security, privacy, and compliance risks. Research indicates that nearly half of employees use AI tools without IT approval, with over a third sharing confidential data with these platforms. To mitigate these growing threats, organizations require robust tools to discover and govern unsanctioned AI apps across their employee devices.

Understanding the Shadow AI Challenge

Shadow AI emerges when employees leverage AI tools—such as generative AI chatbots, coding assistants, or embedded AI features in SaaS platforms—without formal IT approval or security review. This usage is often driven by a desire for increased productivity and efficiency, as employees seek to optimize workflows and meet deadlines using the latest technological advancements. However, the lack of sanctioned, accessible AI tools and slow approval processes often pushes employees towards public, ungoverned options.

The unsupervised nature of shadow AI creates critical vulnerabilities:

Data Leakage and Privacy Breaches: Sensitive corporate data, customer PII, financial projections, or proprietary code can be inadvertently entered into public AI models, which may store this data, use it for model training, or expose it in subsequent user outputs. This can lead to violations of privacy laws like GDPR and significant reputational damage.
Compliance and Regulatory Gaps: Unsanctioned AI usage can bypass established data governance and cybersecurity controls, making it difficult to maintain compliance with frameworks like ISO 27001, SOC 2, or HIPAA. Without audit trails, incident response becomes nearly impossible.
Intellectual Property (IP) Risks: Proprietary algorithms, unpatented designs, or confidential business strategies fed into AI tools could become exposed or lose their protected status, especially if AI providers' terms of service are unclear on data ownership.
Security Vulnerabilities: Integrated but unapproved AI platforms, if compromised, could serve as an attack vector into the corporate network.

With 98% of organizations reporting unsanctioned AI use and 76% actively experiencing "Bring Your Own AI" (BYOAI) within their workforce, the need for comprehensive discovery and governance tools is paramount.

Traditional Approaches to Shadow AI Discovery

Organizations have historically relied on various security and IT management tools to gain visibility into their digital environments. While these tools offer some level of insight, they often fall short in comprehensively addressing the unique challenges posed by shadow AI.

Network Monitoring and Proxy Logs: These tools can track network traffic to known AI service domains. However, they may struggle to identify new or less common AI services, deep AI usage within browser sessions, or AI applications that operate locally on a device before sending data externally. They provide a perimeter view, missing much of the endpoint activity.
SaaS Discovery Tools: Designed to inventory and manage SaaS applications, these tools can identify cloud-based AI applications connected through OAuth grants, APIs, or third-party integrations. While effective for SaaS environments, they often lack visibility into desktop AI apps, command-line coding agents, or Model Context Protocol (MCP) servers that users might configure locally.
Endpoint Detection and Response (EDR) / Data Loss Prevention (DLP): EDR and DLP solutions monitor activity on employee devices. Modern endpoint DLP can detect and block sensitive data from being submitted into external LLM tools. They offer context-aware, on-device security and can identify sensitive data in prompts. However, many traditional DLP systems were not purpose-built for the nuances of AI interactions and may not offer full visibility into all AI tool usage, rather focusing on data exfiltration pathways. Integrating DLP directly into EDR can improve context, but a comprehensive AI app inventory may still be a blind spot.
Mobile Device Management (MDM): MDM platforms are essential for enrolling, configuring, and managing fleets of devices, including pushing applications and enforcing policies. MDM is crucial for deploying endpoint agents, but it generally focuses on device-level control rather than deep introspection into which AI applications or MCP servers are actually running and being used by employees within their local environments. While some MDM solutions are integrating AI for adaptive policies and anomaly detection, they are typically a foundational layer rather than the dedicated AI app discovery mechanism.

These traditional tools provide partial visibility but often leave critical blind spots where shadow AI can thrive, making comprehensive governance challenging.

Purpose-Built Endpoint AI Governance: Bifrost Edge

Closing the shadow AI gap requires a solution that extends governance directly to the endpoint, covering all AI interactions regardless of whether they occur in a browser, a desktop application, or a coding agent. This is where dedicated endpoint AI governance solutions like Bifrost Edge become essential.

Bifrost Edge, the endpoint layer of the Bifrost AI gateway, is designed to bring visibility and control to AI usage on employee machines. It operates on the principle that the same robust governance policies configured in the Bifrost gateway should apply consistently across all AI traffic, including that originating from individual devices. Bifrost, an open-source AI gateway built in Go by Maxim AI, serves as the central control plane and policy engine for virtual keys, budgets, rate limits, routing, guardrails, and audit logs. Bifrost Edge then extends that same governance and security to AI traffic on employee machines, with endpoint enforcement on each device.

Core Capabilities for Shadow AI Discovery and Governance

Bifrost Edge is currently in alpha, offering a powerful approach to endpoint AI governance through several key capabilities:

Automated AI App Discovery and Inventory: Bifrost Edge runs silently on employee devices (macOS, Windows, Linux) and automatically identifies every AI application in use, as well as the MCP servers users have configured within those tools. This builds a real-time, fleet-wide inventory of all AI surfaces, turning shadow AI from a blind spot into a managed asset. Admins gain visibility into hostnames, owners, installed AI apps, and configured MCP servers.
Comprehensive MCP Server Discovery: AI apps increasingly connect to MCP servers, which allow them to read files, call APIs, and take actions. Edge inventories these MCP servers across the fleet, allowing administrators to make per-server allow/deny decisions. A denied server cannot be used, even if an app had it previously configured.
Policy Enforcement on the Device: Administrators can define which AI applications are permitted across the organization, and Edge enforces these decisions at the device level. Allowed apps are fully governed through Bifrost, while disallowed apps are blocked before any data leaves the machine. This policy is centrally managed and automatically synced to all enrolled devices.
Extension of Gateway Governance and Security: Because Bifrost Edge routes all AI traffic through the Bifrost gateway, every guardrail, budget, virtual key, and audit log configured at the gateway applies automatically to endpoint AI. This means sensitive content (e.g., secrets, PII) is caught before it leaves the machine, and compliance requirements are met for prompts and responses from desktop apps, browser AI, and coding agents.

How Bifrost Edge Works in Practice

After a straightforward, MDM-native deployment via platforms like Jamf, Microsoft Intune, or JumpCloud, Bifrost Edge runs as an always-on agent. The user's initial single sign-on (SSO) links their machine to their identity and policies, requiring no API keys or sensitive data on the device itself.

When Edge detects a new AI app or MCP server, it automatically requests approval in the admin console. Administrators can then approve, deny, or configure pending statuses, with decisions taking effect across the fleet upon the next check-in. This continuous feedback loop ensures that policy is always current and enforced where AI is actually used.

The seamless routing means that applications like Claude Desktop, ChatGPT in the browser, Cursor, and various coding agents (Claude Code, Codex CLI, Gemini CLI) automatically fall under the organization's governance.

Conclusion

The proliferation of unsanctioned AI applications on employee devices presents a significant and evolving risk to enterprise security and compliance. While traditional security tools offer some layers of protection, they often lack the purpose-built capabilities required to comprehensively discover and govern AI usage at the endpoint.

Dedicated endpoint AI governance solutions are essential for mitigating shadow AI risks. Bifrost Edge, combined with the Bifrost AI gateway, provides a robust framework for identifying every AI application and MCP server in use, enforcing granular policies, and extending existing governance and security controls to every machine. This approach transforms shadow AI from an invisible threat into a managed, compliant part of the enterprise AI landscape, safeguarding sensitive data and intellectual property. Teams evaluating AI gateways can request a Bifrost demo or review the open-source repository to learn more about its capabilities and how Bifrost Edge extends governance to the endpoint.

Sources

Portal26 Platform Feature. "Enterprise Shadow AI Discovery Engine." Portal26. https://portal26.com/features/shadow-ai-detection/
deeploi. "Employees using AI without IT approval: How to safeguard your company." deeploi. https://www.deeploi.io/blog/employees-using-ai-without-it-approval/
BigID. "Shadow AI Discovery & Governance for Enterprise AI Risk." BigID. https://www.bigid.com/solutions/shadow-ai/
Reco AI. "Top 10 Shadow AI Detection Tools for Enterprise Security in 2026." Reco AI. https://reco.ai/blog/shadow-ai-detection-tools/
UpGuard. "Shadow AI: Managing the Security Risks of Unsanctioned AI Tools." UpGuard. https://www.upguard.com/blog/shadow-ai

Governing Shadow AI Across Your Organization

Soren Lindqvist — Thu, 02 Jul 2026 17:23:55 +0000

Shadow AI, the use of unapproved AI tools by employees, creates significant security and compliance risks. A unified approach combining a central AI gateway like Bifrost with an endpoint agent provides the visibility and control needed to manage this risk without stifling innovation.

The use of unapproved AI tools and services within an organization, often called "Shadow AI," has become a critical governance challenge. Driven by a desire for greater productivity, employees across all departments are adopting public AI chatbots, coding assistants, and browser extensions, often without the knowledge or approval of IT and security teams. While the intent is typically harmless, this practice introduces significant risks, including data leakage, compliance violations, and intellectual property theft. Recent surveys highlight the scale of the problem, with one showing 76% of employees use personally sourced AI tools for work, and another finding nearly half have shared sensitive work data with unapproved tools.

This article examines the risks of shadow AI and outlines a modern, enforceable governance strategy. It is not about banning AI, but about creating a sanctioned, observable, and secure way for employees to use it. An effective solution requires a combination of a centralized policy engine and endpoint enforcement, a model exemplified by tools like Bifrost, an open-source AI gateway from Maxim AI.

The Problem with Unmanaged AI

Shadow AI is a specific and more complex evolution of shadow IT. Unlike traditional unauthorized software, generative AI tools are designed to process and learn from the data they are given. This creates several distinct and high-stakes risks for any organization where AI usage is not visible or controlled.

Key Risks of Shadow AI

Data Leakage and Privacy Breaches: This is the most immediate threat. Employees may paste sensitive information, such as customer data, internal financial figures, or proprietary source code, into public AI models. This can lead to that data being used to train public models or being exposed in other ways, creating severe privacy and compliance issues under regulations like GDPR and HIPAA.
Intellectual Property Theft: When developers use public AI code assistants to write or optimize proprietary algorithms, they risk that unique code being absorbed and replicated by the model for other users.
Security Vulnerabilities: Unvetted AI tools, especially browser extensions and IDE plugins, can introduce new attack surfaces. These tools often require high-risk permissions to access files, clipboards, or network connections, creating potential entry points for malware or data exfiltration.
Compliance and Regulatory Violations: The invisible nature of shadow AI means organizations can unknowingly violate regulatory requirements for data handling and storage, which may only come to light during an audit or after an incident.

The core of the problem is a lack of visibility. Security and compliance teams cannot govern tools they do not know are being used. Traditional network monitoring often fails to capture the full picture, especially as AI capabilities become embedded inside already-approved SaaS applications.

A Framework for Effective AI Governance

Attempting to ban all unapproved AI tools is often impractical and counterproductive. Employees will find ways to use the tools they find effective, driving the behavior further into the shadows. A more sustainable strategy focuses on creating a secure and sanctioned path for AI adoption that balances productivity with robust governance.

This framework requires two core components working in tandem: a central control plane and an endpoint enforcement agent.

Centralized AI Gateway (The Control Plane): An AI gateway acts as a single point of entry for all AI traffic. It is where the organization defines and enforces its AI policies. Key functions include managing access with virtual keys, setting budgets and rate limits, applying security guardrails, and creating a complete audit trail of all requests and responses. The Bifrost AI gateway serves this role, providing a unified API for over 20 providers while centralizing governance and control.
Endpoint Governance Agent (The Enforcement Layer): A gateway can only govern traffic that is explicitly directed to it. To solve the shadow AI problem, organizations need a way to ensure all AI tools on employee machines, from desktop apps to browser-based AI, route through the central gateway. An endpoint agent installed on each machine accomplishes this by transparently intercepting and routing AI traffic according to central policy.

This dual approach moves governance from a passive, opt-in model to an active, enforced one. It gives organizations the visibility and control they need to manage risk effectively.

Implementing Governed AI with Bifrost and Bifrost Edge

The combination of the Bifrost gateway and its endpoint component, Bifrost Edge, provides a practical implementation of this governance framework. The platform is designed to bring shadow AI into the light and apply consistent, centrally managed policies everywhere.

How It Works

The system operates on a simple but powerful principle: the gateway is the brain, and the endpoint agent is the reach.

Bifrost as the Policy Engine: Administrators use the Bifrost Enterprise gateway to configure all AI governance rules. This includes creating virtual keys for different users or projects, setting spending limits, defining routing rules across different models, and configuring security guardrails to block sensitive data. All activity is captured in immutable audit logs for compliance.
Bifrost Edge for Endpoint Enforcement: Bifrost Edge is an agent that runs on each employee's macOS, Windows, or Linux machine. It is deployed fleet-wide via MDM platforms like Jamf or Intune. Once installed, it automatically identifies and routes traffic from supported AI applications—including desktop apps like Claude and ChatGPT, coding agents, and AI websites—through the organization's Bifrost gateway.

This architecture ensures that every AI request, regardless of its origin on the device, is subject to the same set of security and compliance controls.

From Visibility to Control

The first step in managing shadow AI is discovering what is being used. Bifrost Edge builds a fleet-wide inventory of all detected AI applications and MCP servers, giving administrators a real-time view of AI usage across the company.

From this dashboard, they can take direct action:

Approve or Deny Applications: Administrators can create an allowlist of sanctioned AI tools. Traffic from approved apps is routed through the gateway and governed, while traffic from denied apps is blocked at the source.
Govern MCP Servers: Edge discovers which external MCP servers are configured in tools like Claude Code or Cursor, a common blind spot for many organizations. These can be approved or denied on a per-server basis, preventing unvetted tools from being executed by AI agents.
Enforce Guardrails Everywhere: Because all traffic flows through Bifrost, guardrails that detect and block PII, secrets, or other sensitive data are applied to prompts and responses from any app on the endpoint, securing data before it leaves the machine.

This model allows organizations to transition from a reactive posture to proactive governance, creating a secure environment for AI innovation without putting sensitive data at risk.

Conclusion

Shadow AI is not a problem that can be solved with policy documents alone. It is a technical challenge that requires a technical solution. Employees will continue to adopt the most effective tools available to do their jobs, making visibility and automated enforcement essential.

By combining a central AI gateway for policy management with an endpoint agent for enforcement, organizations can gain control over unmanaged AI usage. This approach, exemplified by the Bifrost AI gateway and Bifrost Edge, allows businesses to harness the productivity gains of AI securely and compliantly. Teams evaluating solutions for governing AI can request a Bifrost demo or review the open-source repository to learn more.