Adversarial AI Attacks, Mitigations, and Defense Strategies

A cybersecurity professional's guide to AI attacks, threat modeling, and securing AI with MLSecOps

John Sotiropoulos

• Publisher: Packt Publishing
• Year: 2024
• eBook ISBN: 9781835088678
• Topic: Computer Science
• Subtopic: Artificial Intelligence (AI) & Semantics
• Index: Computer Science

"The book not only explains how adversarial attacks work but also shows you how to build your own test environment and run attacks to see how they can corrupt ML models. It's a comprehensive guide that walks you through the technical details and then flips to show you how to defend against these very same attacks." – Elaine Doyle, VP and Cybersecurity Architect, Salesforce Get With Your Book: PDF Copy, AI Assistant, and Next-Gen Reader Free

Key Features

• Understand the unique security challenges presented by predictive and generative AI
• Explore common adversarial attack strategies as well as emerging threats such as prompt injection
• Mitigate the risks of attack on your AI system with threat modeling and secure-by-design methods

Book Description

Adversarial attacks trick AI systems with malicious data, creating new security risks by exploiting how AI learns. This challenges cybersecurity as it forces us to defend against a whole new kind of threat. This book demystifies adversarial attacks and equips you with the skills to secure AI technologies, moving beyond research hype or business-as-usual activities. Learn how to defend AI and LLM systems against manipulation and intrusion through adversarial attacks such as poisoning, trojan horses, and model extraction, leveraging DevSecOps, MLOps, and other methods to secure systems. This strategy-based book is a comprehensive guide to AI security, combining structured frameworks with practical examples to help you identify and counter adversarial attacks. Part 1 introduces the foundations of AI and adversarial attacks. Parts 2, 3, and 4 cover key attack types, showing how each is performed and how to defend against them. Part 5 presents secure-by-design AI strategies, including threat modeling, MLSecOps, and guidance aligned with OWASP and NIST. The book concludes with a blueprint for maturing enterprise AI security based on NIST pillars, addressing ethics and safety under Trustworthy AI. By the end of this book, you'll be able to develop, deploy, and secure AI systems against the threat of adversarial attacks effectively.

What you will learn

• Set up a playground to explore how adversarial attacks work
• Discover how AI models can be poisoned and what you can do to prevent this
• Learn about the use of trojan horses to tamper with and reprogram models
• Understand supply chain risks
• Examine how your models or data can be stolen in privacy attacks
• See how GANs are weaponized for Deepfake creation and cyberattacks
• Explore emerging LLM-specific attacks, such as prompt injection
• Leverage DevSecOps, MLOps and MLSecOps to secure your AI system

Who this book is for

This book tackles AI security from both angles - offense and defence. AI developers and engineers will learn how to create secure systems, while cybersecurity professionals, such as security architects, analysts, engineers, ethical hackers, penetration testers, and incident responders will discover methods to combat threats to AI and mitigate the risks posed by attackers. The book also provides a secure-by-design approach for leaders to build AI with security in mind. To get the most out of this book, you'll need a basic understanding of security, ML concepts, and Python.

]]>

Table of contents

• Adversarial AI Attacks, Mitigations, and Defense Strategies
• Contributors
• Preface
• Part 1: Introduction to Adversarial AI
• 1
• 2
• 3
• Part 2: Model Development Attacks
• 4
• 5
• 6
• Part 3: Attacks on Deployed AI
• 7
• 8
• 9
• 10
• Part 4: Generative AI and Adversarial Attacks
• 11
• 12
• 13
• 14
• 15
• 16
• Part 5: Secure-by-Design AI and MLSecOps
• 17
• 18
• 19
• 20
• Index
• Other Books You May Enjoy