Security Risks of Agentic AI in Pharma Software Development

Security Risks of Agentic AI in Pharma Software Development

Vijay Raina is a seasoned veteran in the enterprise SaaS landscape, currently guiding major pharmaceutical players through the complex intersection of software architecture and artificial intelligence. As life sciences organizations rush to modernize clinical trial management and real-world evidence platforms, Vijay provides the architectural blueprint for doing so without sacrificing the sanctity of patient data. His expertise is particularly vital now, as the industry shifts from simple coding assistants to autonomous agents that can modify entire repositories. We sat down to discuss how the rise of the AI-driven Development Lifecycle is rewriting the rules of application security, the hidden dangers of “hallucinated” software dependencies, and the increasingly high stakes of global regulatory compliance.

AI models currently produce functional code at high rates, yet a significant majority of that code is riddled with vulnerabilities; how does this fundamental gap impact the pharmaceutical sector’s push to modernize legacy infrastructure?

The reality on the ground is quite startling when you look at the raw data. We are seeing frontier AI models generate functional code between 83% and 95% of the time, which creates a deceptive sense of progress for development teams. However, when you peel back the layers, only about 24% to 36% of that code is actually secure. Even when developers try to use AI-assisted security techniques to patch those holes, the security rate only climbs to a maximum of 56%. For a pharma company refactoring a legacy system that handles sensitive clinical research, this is a minefield. You might be translating an old, clunky architecture into something that looks modern and runs efficiently, but the AI could be surfacing vulnerabilities that were dormant for decades or introducing entirely new ones during the translation process. Modernized code isn’t inherently secure just because it was written with 2026 tools; in fact, the speed of AI generation often masks deep structural flaws that could lead to a massive data breach if not caught by a human-in-the-loop.

With the EU AI Act now carrying heavy penalties and US regulations like AB 3030 coming into play, how are these legal shifts reshaping the way life sciences organizations handle patient data in AI prompts?

The regulatory floor is rising so fast that many organizations are struggling to keep their footing. In the European Union, we are now looking at potential fines of up to €35 million or 7% of global annual turnover for the most serious AI-related violations—that is a ceiling that actually dwarfs the maximum penalties we saw under GDPR. In the United States, California’s AB 3030 is already forcing a culture of transparency by requiring health facilities to disclose when generative AI is used to communicate clinical information without a licensed provider’s review. The technical pressure point here is the “mosaic effect,” where AI models have become so sophisticated that they can cross-reference supposedly anonymized trial data against public records to re-identify individual patients. This makes the old methods of simply removing names and direct identifiers completely obsolete. If a developer accidentally leaks protected health information into an external AI prompt without a signed Business Associate Agreement, it isn’t just a technical slip-up; it is a full-blown compliance disaster that can derail a multi-billion dollar drug trial.

We are seeing a shift from simple AI assistants to autonomous AI agents that can modify repositories and run tests; what are the specific governance challenges when an AI agent has a broader operational footprint?

This shift toward what we call the AI-driven Development Lifecycle, or AI-DLC, changes everything about how we think regarding least-privilege access. We are no longer just talking about a tool that suggests a single line of code; we are talking about agents that can work across an entire repository, modify dozens of files simultaneously, invoke external tools, and interact with other internal systems. In the pharmaceutical world, where reliability, integrity, and traceability are the three pillars of research, an autonomous agent with too much power is a massive liability. If an agent has the permission to modify a clinical trial management platform’s database schema or pull request logic without strict oversight, the potential for a “silent” corruption of data integrity is terrifying. Governance now has to account for the agent’s entire operational footprint—every tool it calls and every system it touches must be monitored and audited with the same level of scrutiny we apply to human developers, if not more.

How can attackers exploit the way AI models recommend open-source packages, and what does this mean for the pharmaceutical software supply chain?

This is one of the most insidious threats we are facing right now because it targets the developer’s trust. Large language models often “hallucinate” the names of open-source packages that don’t actually exist in the real world. Attackers have figured this out and are proactively registering those hallucinated names on public registries and seeding them with malicious code. A developer, or even an autonomous AI agent, might accept one of these recommendations because it sounds like a legitimate library for, say, a real-world evidence analytics platform. Once that compromised dependency is pulled into the environment, the vulnerability isn’t even in the code the team wrote—it’s baked into the supply chain. For a company handling proprietary research or sensitive patient registries, a single malicious dependency can act as a silent backdoor that bypasses all traditional application security controls, allowing attackers to exfiltrate data directly from the development pipeline.

The traditional model of security as a downstream checkpoint seems to be failing in the face of AI speed; how can organizations integrate “agentic security” to provide feedback at the pace of modern development?

The old “gatekeeper” model, where security testing happens right before a release, is completely incompatible with the speed of AI. If your AI agents are iterating on code continuously, a security review that happens two weeks later is already ancient history. We have to move toward agentic security models where the AI itself participates in identifying and remediating vulnerabilities in real-time. This means embedding security analysis directly into the development environments, repositories, and CI/CD pipelines where the work is actually happening. The goal is to provide feedback at the exact moment a prompt is being translated into code. We want to catch an exposed secret or an unsafe dependency before it ever leaves the developer’s workstation. By using AI defensively to triage findings and suggest fixes, we can ensure that security analysis keeps pace with software creation, turning AppSec into a continuous feedback loop rather than a series of disconnected hurdles that everyone tries to jump over or work around.

What is your forecast for the AI-driven Development Lifecycle in healthcare?

I believe we are entering an era where the distinction between “building” and “securing” software will effectively vanish. Over the next few years, I expect to see pharmaceutical organizations move away from treating AI as a mere assistant and toward a model where humans act as high-level architects overseeing a fleet of specialized AI agents. The winners in this space will be the ones who successfully implement a “secure-by-design” agentic environment where visibility, least-privilege access, and automated audit trails are baked into the infrastructure from day one. We will see a massive surge in AI-native engineering that allows us to deploy clinical trial infrastructure in days rather than months, but this speed will be anchored by sophisticated defensive AI that prevents data leakage before it occurs. Ultimately, the industry’s success won’t be measured by how much code we can generate, but by how effectively we can maintain the absolute trust of patients and regulators while moving at the speed of light.

Subscribe to our weekly news digest.

Join now and become a part of our fast-growing community.

Invalid Email Address
Thanks for Subscribing!
We'll be sending you our best soon!
Something went wrong, please try again later