Where to look for generative AI risks

Where to look for generative AI risks

Where to look for generative AI risks

https://mitsloan.mit.edu/ideas-made-to-matter/where-to-look-generative-ai-risks

Publish Date: 2026-03-16 13:06:00

Source Domain: mitsloan.mit.edu

  • Generative AI’s Dual Impact on Business: While generative AI offers significant productivity and growth prospects, it also substantially increases business risk, particularly during full-scale deployment.

  • Two Types of Generative AI Risk: The research by MIT Center for Information Systems Research identifies two types of risk: embedded risks, inherently tied to the technology (influenced by model behavior and training data), and enacted risks, shaped by organizational choices in deployment (system prompts, safeguards, and agent permissions).

  • Components Leading to Risk: Potential risks illustrate from a hiring manager using AI tools to draft a job description, including issues with training data, foundation models, user prompts, and system prompts.

  • Advanced AI Uses Introduce Additional Threats: Sophisticated deployments, such as retrieval-augmented generation and AI agents, can expand the risk space through data quality issues, control gaps in vector databases, and challenges in accountability due to autonomy creep.

  • Action Plan for Mitigating Risk: Organizations should map exposure, adopt dual approaches to risk management, establish clear ownership, and maintain audit trails to understand and mitigate the generative AI risk space effectively.