Cookies on this site

We would like to use cookies to understand how the site is used and to measure our campaigns. Nothing is set until you choose, and you can change your mind at any time from “Cookie settings” at the foot of every page. Privacy policy

Contact UsContact Us

Resources / Blogs

Security & compliance

A Short Retrospective: Four RAI and Security Incidents That Shaped Microsoft Copilot Studio

Explore four Microsoft Copilot Studio security incidents that exposed AI security risks, prompt injection threats, and key AI governance lessons.

· · 5 min read

What eighteen months of disclosed flaws and demonstrated attacks tell us about agent risk?

Between August 2024 and January 2026, four publicly disclosed incidents involving Microsoft Copilot Studio agents reshaped how the security community thinks about AI security risks, AI agent security, and governance within low-code AI platforms. None of these incidents required advanced exploit chains or complex techniques. Instead, they highlighted how Copilot Studio security risks can emerge from infrastructure vulnerabilities, identity abuse, and agent-layer weaknesses.

Taken together, the incidents below illustrate a critical shift: AI agents are not just responding systems; they are execution systems operating across enterprise data and services. As organizations accelerate adoption of AI-powered workflows, enterprise AI security and AI risk management have become essential considerations. This short retrospective walks through the four incidents in order, then steps back to examine what they reveal about the evolving threat landscape.

image (71)

August 2024: The SSRF Bypass (CVE-2024-38206)

The first significant disclosure was a server-side request forgery (SSRF vulnerability) in Copilot Studio, rated CVSS 8.5 and described by Microsoft as a critical information-disclosure flaw. An authenticated attacker could bypass SSRF protection to leak sensitive information from the service’s internal network.

The issue was reported by Evan Grant at Tenable, which noted that while the technique did not cross tenant boundaries, the shared infrastructure beneath Copilot Studio meant elevated access could affect multiple customers. Microsoft confirmed that the flaw was fully mitigated in its August 6, 2024, advisory.

The case raised broader concerns about internal infrastructure exposure and how shared services underpin Copilot Studio environments, reminding defenders that Microsoft Copilot Studio security depends not only on agent configurations but also on the underlying SaaS architecture. It reinforced the importance of vulnerability management as a foundational element of enterprise AI security.

October 2025: CoPhish

Datadog Security Labs disclosed a phishing technique called CoPhish that abused Copilot Studio’s demo-website feature to deliver OAuth consent prompts from a legitimate Microsoft domain. The attack did not exploit a software bug at all; it weaponized a normal feature. Because the consent page was served from copilotstudio.microsoft.com, victims and their security tooling had little reason to be suspicious, and the granted tokens could be exfiltrated through the agent itself.

Microsoft acknowledged the report and pointed customers toward stronger consent policies and restrictions on app registration while it worked on product updates.

CoPhish serves as a reminder that OAuth phishing attacks, identity controls, and consent management are critical aspects of AI governance. A technically secure agent can still be exposed through weak identity practices. As organizations deploy more AI-powered business processes, governance of user permissions becomes just as important as securing the agent itself.

December 2025: The Tenable Travel-Agent Demonstration

Tenable AI Research published a proof of concept in which a Copilot Studio travel-booking agent, built with demo data and explicit identity-verification instructions, was hijacked by a simple prompt injection attack. The agent disclosed payment-card details for other customers and updated a booking price from one thousand dollars to zero, all without any hacking skills.

The work made tangible an idea security teams had been discussing in the abstract: an agent’s natural-language instructions are not a control boundary, and overly broad action permissions turn small injection successes into financial and data-leak events.

The demonstration highlighted a growing challenge in AI agent security. It showed that natural-language instructions alone cannot prevent misuse and that excessive permissions increase the likelihood of AI data leakage and operational risk. Organizations adopting AI agents should prioritize least-privilege access and continuous validation of agent actions as part of a broader AI risk assessment strategy.

January 2026: CVE-2026-21520

Capsule Security disclosed an indirect prompt injection vulnerability in Copilot Studio, which Microsoft assigned CVE-2026-21520 with a CVSS score of 7.5 and patched on January 15, 2026.

The technical impact mattered, but the bigger signal was the CVE itself. Microsoft’s decision to assign an identifier to a prompt-injection flaw in an agent-building platform was described by independent researchers as highly unusual. It suggested that injection-class issues in agentic systems are beginning to receive the same level of scrutiny as traditional software vulnerabilities.

The incident further reinforced an important reality in Microsoft Copilot security: even after a vulnerability is patched, legitimate connectors and integrations can still facilitate unintended data movement. This is why AI security best practices must extend beyond detection to include enforcement, monitoring, and governance controls.

The Pattern Across Eighteen Months

Two of the four incidents were classic vendor-side flaws: a server-side request forgery and a prompt-injection bug that Microsoft patched on its own infrastructure. The other two were not bugs at all. CoPhish abused a normal platform feature, and the Tenable demonstration exploited an agent’s permission scope and the model’s willingness to follow injected instructions.

That mix is the most useful takeaway, revealing three distinct risk surfaces:

  • Platform vulnerabilities, such as SSRF and patched prompt-injection flaws.
  • Identity and feature abuse, exemplified by CoPhish and OAuth phishing attacks.
  • Agent-layer risks, including prompt injection attacks, excessive permissions, and data exposure.

Hardening a Copilot Studio deployment now means tracking these three surfaces in parallel: the platform itself, the identity and consent perimeter around it, and the instruction and connector scope of every agent built on top of it.

For organizations focused on AI governance, enterprise AI security, and AI threat modeling, traditional vulnerability tracking alone cannot provide complete protection. Security programs must address data access, permission management, prompt handling, and action execution as part of a unified security strategy.

Conclusion

Copilot Studio represents a shift from passive AI assistance to active AI execution. These incidents collectively demonstrate that even minor instruction manipulation can have amplified consequences when agents have access to enterprise systems.

For organizations, the path forward requires a Zero Trust AI approach that combines least-privilege access, continuous monitoring, action auditing, and rigorous testing against adversarial inputs. As AI security risks continue to evolve, businesses must strengthen AI governance, improve AI risk management, and adopt comprehensive AI agent security practices to reduce exposure.

The lesson is straightforward: as AI capabilities expand, security and governance must evolve alongside them.

← All articles

Case studies

Microsoft Consulting in practice

Client names are withheld. We are happy to share details on a call.

All case studies
  • Delivered

    600k files, < 3 days

    Document management

    Microsoft

    600,000 documents moved from ImageRight to SharePoint in under three days

    A one-file-at-a-time script would have needed about 22 days of continuous running. We rebuilt the migration around a SQL work queue with parallel uploads, automatic retries and crash recovery, and it finished unattended in under three days.

    • 1,125 → 8,314 files per hour
    • Under 3 days instead of about 22
  • Product

    Every prompt screened

    Any industry on Microsoft 365

    Microsoft

    AI activity and data posture for Microsoft 365

    Sentinel watches Copilot and Copilot Studio agents in a Microsoft 365 tenant. It logs prompts and tool calls, scores each agent's risk, flags oversharing and stale access, and screens prompts for injection attempts with a classifier that runs locally at no per-call cost.

    • Every agent prompt screened
    • Runs inside the customer's own Azure tenant
  • In production

    Hours → minutes

    Food manufacturing

    AI Consulting

    Document intake agent for a national food cooperative

    A Copilot Studio agent reads certificates of analysis as they arrive in the quality team's inbox, extracts 14 fields with AI Builder, checks them, files the PDF in SharePoint and posts a summary in Teams. Fields it is unsure about go to a person instead of being guessed.

    • Hours of daily filing down to minutes
    • 14 fields per document, validated

Keep reading

All Security & compliance articles

See what Copilot and your users can reach

A 30-minute demo of Princeton Sentinel on sample data: AI activity and data posture across Microsoft 365, with the engineers who build it.