DEV Community

Nathaniel Darch
Nathaniel Darch

Posted on

Securing Agentic AI Research Paper

Introduction
As AI agents become embedded in enterprise workflows; reading emails, managing code repositories, and accessing private databases, they have quickly become one of the biggest targets in cybersecurity. This paper examines a specific threat, Indirect Prompt Injection (IPI), where malicious instructions are hidden inside external content that can hijack any agent that ingests said content, allowing data theft and/or remote code execution. The research problem is architectural: What pipeline design practices are most commonly implemented when an AI agent needs sensitive information and how can DevOps teams balance operational utility with the security restrictions needed to mitigate IPI?
My interest in this topic stems from my journey into tech, which began with CIS 3003 and hands-on work like setting up camera systems for small businesses, real experiences that taught me that every system with sensitive information has to balance this battle of operational efficiency with data security. IPI is not theoretical, documented attacks have already manipulated large names like GitHub Copilot into exfiltrating private source code and achieving remote code execution. This affects every organization that adopts AI. This paper argues that resolving it requires fundamentally changing the DevOps pipeline design, emphasizing zero-trust memory architectures and semantic-intent-based access controls to safely process data.

GEP Connection
My journey into the tech field started when I took CIS 3003: Fundamentals of Information Technology. That course is what made me want to pursue a career working with computers and systems. I have a strong passion for helping individuals like family and businesses solve their technical challenges. For example, the picture shown shows my brother setting up a ladder for me before I run ethernet to setup a 16 channel camera system for a small business. CIS 3003 introduced me to the core of tech, and how practical the skills you learn would be. Most importantly, it helped me discover a path that makes my job not feel like work at all.

Research Question
What architecture or pipeline design practices are most commonly implemented when an AI agent requires sensitive data in order to prevent potential attacks? How can DevOps teams
balance operational utility with the necessary security protocols to mitigate IPI?

Thesis Statement
Securing autonomous AI agents against Indirect Prompt Injection (IPI) demands a fundamental shift in DevOps pipeline design; rather than enforcing restrictive sanitization that bottlenecks AI utility, organizations must adopt zero-trust memory architectures and intent-based access controls to safely process sensitive data.

Literature Review
The rapid implementation of autonomous AI agents into enterprise workflows has fundamentally changed not just the cybersecurity landscape, but the world. It introduced a paradox where agents could serve as powerful operational tools, but also be used for new attack surfaces. This is reiterated by Xu Y. et al. (2026), as they emphasize that agents autonomy drastically broadens the attack surface through action hijacking and tool abuse. A critical vulnerability within this structure is called Indirect Prompt Injection (IPI), a technique where malicious instructions are embedded into external content that an AI agent ingests. The severity of IPI is showcased with authority escalation, where the tool-calling capabilities of a model turn text instructions into a huge system breach. Real-world evidence demonstrates the potential of these exploits in development environments. For example, Omer Mayraz (2025) documented the CamoLeak vulnerability, an exploit where invisible Markdown hidden within GitHub pull requests caused Copilot to silently send private source code. In a similar situation, Wunderwuzzi (2025) demonstrated how an attacker utilized IPI to manipulate GitHub Copilot into rewriting its own workspace configuration files, ultimately achieving remote code execution.
These primary cases highlight a significant gap in our current defenses. Traditional application security management is completely blind to the new threats posed by agentic AI. Historically, organizations relied on input sanitation and surface-level Content Security Policies to filer our malicious code. The problem with restrictive sanitization is that it bottlenecks the capabilities of AI models, creating a problem for scalable solutions for autonomous operations. Increased sanitization also completely fail to prevent more sophisticated exploits. Ferrag et al. (2026) mentions extensive vulnerabilities across agent to agent and Model Context Protocol (MCP) communication layers, which tells us that attacks can easily go through basic filters by exploiting the communication protocols of AI workflows.
To resolve these inconsistencies without tarnishing the AI’s performance, researchers advocate for the implementation of intent-based access controls and semantic defenses. Alamsabi et al. (2026) propose an embedding-based detection layer that operates agnostically across models. This layer would constantly evaluate the user’s intent and the external context to intercept malicious IPIs before they are executed. This way, external content can be screened for malicious intent, not just malicious syntax. Similarly, Milani et al. (2026) introduced the Outer Prompt Extension (OPE) framework, which basically sets strict boundaries that separate executable commands from any ingested data. In real-world enterprise environments, such as Security Operations Centers (SOCs), companies control AI by using human-written rules that can override the system at any time. Xu, D et al. (2026) highlights how using these fixed, policy-driven boundaries can safely manage private data without slowing down entire system workflows.
While these semantic and intent-based layers provide a strong front-line of defense, securing the entire environment requires shifting towards zero-trust memory architectures. AI agents cannot safely process sensitive data if they also retain write-access to their own execution guardrails. For example, an AI agent tasked with processing sensitive health records can be tricked by a malicious email into changing its own security settings, allowing private data to leak to an attacker. Dhivyasree et al. (2026) validate the necessity of architectural confinement through the Cognitive Autonomous Memory Security (CAMS) model, which uses a five-layer defense architecture to protect long-term memory through continuous temporal and intent checks. The continuous isolation makes it near-impossible for multi-stage IPIs to progress, without bottlenecking systems. Additionally, Kanaker et al. (2026) uses Monte Carlo simulations to prove that the least-privilege sandboxing and retrieval allowlisting are the most statistically effective controls for reducing the blast radius of compromised agents.
To implement these architectural shifts into DevOps, the entire pipeline needs to be redesigned. Organizations must adopt default-deny tool scooping, continuously track what the AI is doing, and digitally sign all incoming data so it can be verified it comes from a trusted source. This is emphasized when Akasam (2026) says that securing enterprise agent deployments requires continuous runtime telemetry and the use of cryptographically signed artifacts.
Despite these advancements, the literature reveals that defenses against IPI remain largely fragmented rather than standardized across DevOps environments. Existing research tends to address each threat layer in isolation: Alamsabi et al. (2026) and Milani et al. (2026) detect malicious intent at the input layer, Dhivyasree et al. (2026) and Kanaker et al. (2026) confine agent memory and permissions, while Akasam (2026) reinforces the deployment pipelines. There is no framework that bridges these layers. Also, because these defenses are mostly architectural, it is still unknown how they will perform within real enterprise settings where agents operate across multiple layers. Taken together, the literature points to a gap, the need for an integrated framework that bridges each of these architectures into a single pipeline.

Conclusion
Securing autonomous AI agents against Indirect Prompt Injection demands a fundamental shift in DevOps pipeline design: rather than enforcing restrictive sanitation that bottlenecks systems, organizations must adopt zero-trust memory architectures and semantic-intent-based access controls to safely process data. The research strongly supports this position across every single layer we have gone through. At the input later, the embedding-based detection and Outer Prompt Extension show that screening for malicious intent, rather than syntax, intercepts IPIs without affecting performance. At the architectural level, the CAMS model and Monte Carlo simulations of least-privilege sandboxing prove that confining agent memory and permissions drastically shrinks blast radius of a compromised agent. And at the pipeline layer, continuous runtime telemetry with cryptographically signed artifacts ensure that incoming data can be verified and tracked. Real-world exploits like CamoLeak and the Copilot configuration hijack confirm these are active threats, yet the literature lacks a single unified framework bridging these layers.
What makes this issue so interesting is that it reaches way past computer science. At its core, IPI is a trust vulnerability between humans, machines, and data, but other fields have been dealing with similar issues for decades. For example, we can look at how a hospital restricts patient records for only a need-to-know basis, which echos the zero-trust principle securing AI agents. Or more generally in management, determining how much authority to delegate to an employee, too much freedom can make things unpredictable while too little can restrict productivity. This can even be brought back into my own personal experiences, when I set up that camera system for a small business, the central question was identical, “Who gets access to the cameras?” or more generally, “How do you give a system enough access to be useful without enough access to be dangerous?” Similarly to how the cameras needed to see everything while being accessible to almost no one, AI agents must touch sensitive data while trusting almost nothing. Ultimately, securing AI against IPI is about more than protecting code, it is about preserving human and machine collaboration and trust.

Works Cited, All Peer Reviewed
Milani, A., Franzoni, V., & Florindi, E. (2026). Indirect prompt injection in large language models: Indirect Prompt Injection in Large Language Models. Neural Computing & Applications, 38(13), Article 530. https://doi.org/10.1007/s00521-026-12266-x
Alamsabi, M., Tchuindjang, M., & Brohi, S. (2026). Embedding-Based Detection of Indirect Prompt Injection Attacks in Large Language Models Using Semantic Context Analysis. Algorithms, 19(1), 92. https://doi.org/10.3390/a19010092
Kanaker, H., Fakhouri, H., Karim, N. A., Abuhamdeh, M., Ismail, N. H. A., & Fakhouri, S. (2026). Securing Tool-Using AI Agents Against Injection and Authority Misuse. Computation, 14(5), 98. https://doi.org/10.3390/computation14050098
Bala Thripura Akasam. (2026). Securing Agentic AI Systems: Threat Models and Penetration Testing Strategies for Enterprise Deployments. Computer Fraud & Security, 1234–1244. https://doi.org/10.52710/cfs.1058
T., D., S., S., Ramamoorthy, A. K., & Balasubramanian, U. M. (2026). Cognitive Autonomous Memory Security (CAMS) against injection and extraction attacks in long-term memory of AI agents. Egyptian Informatics Journal, 34, Article 100983. https://doi.org/10.1016/j.eij.2026.100983
Xu, D., Gondal, I., Yi, X., Susnjak, T., & McIntosh, T. (2026). Seek and You Shall SOC: Blending Human Expertise with Multimodal Generative AI for Scalable Threat Prevention. ACM Transactions on Internet Technology. https://doi.org/10.1145/3799420
Xu, Y., Zhuang, Y., Liu, X., Zhang, T., Xiao, B., Xu, X., Jiang, D., Wang, J., & Hu, H. (2026). LLM agents security duality: a comprehensive survey of self-security and empowered cybersecurity. The Artificial Intelligence Review, 59(8), Article 174. https://doi.org/10.1007/s10462-026-11563-0
Ferrag, M. A., Tihanyi, N., Hamouda, D., Maglaras, L., Lakas, A., & Debbah, M. (2026). From prompt injections to protocol exploits: Threats in LLM-powered AI agents workflows. ICT Express, 12(2), 353–383. https://doi.org/10.1016/j.icte.2025.12.001
Works Cited, Primary Sources (Blogs/IPI Examples)
Mayraz, O. (2026, February 12). CamoLeak: Critical github copilot vulnerability leaks private source code. Application Security Posture Management from Code to Cloud. https://www.legitsecurity.com/blog/camoleak-critical-github-copilot-vulnerability-leaks-private-source-code
Wunderwuzzi. (2025, August 12). GitHub copilot: Remote code execution via prompt injection (CVE-2025-53773) · embrace the red. Embrace The Red. https://embracethered.com/blog/posts/2025/github-copilot-remote-code-execution-via-prompt-injection/

Top comments (0)