Robustness and Cybersecurity in the EU Artificial Intelligence Act
cs.AI, cs.CR, cs.CY, cs.LG
Submitted: 2025-02-22
Updated: 2026-10-10
Comments: A previous version contained an incorrect publication year for the AI Act on page 1. This has been corrected
Journal ref: The 2025 ACM Conference on Fairness, Accountability, and Transparency
Project page: https://secml2018.github.io
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: The EU Artificial Intelligence Act (AIA) establishes different legal principles for different types of AI systems.
Terminology
Abstract
The EU Artificial Intelligence Act (AIA) establishes different legal principles for different types of AI systems. While prior work has sought to clarify some of these principles, little attention has been paid to robustness and cybersecurity. This paper aims to fill this gap. We identify legal challenges and shortcomings in provisions related to robustness and cybersecurity for high-risk AI systems(Art. 15 AIA) and general-purpose AI models (Art. 55 AIA). We show that robustness and cybersecurity demand resilience against performance disruptions. Furthermore, we assess potential challenges in implementing these provisions in light of recent advancements in the machine learning (ML) literature. Our analysis informs efforts to develop harmonized standards, guidelines by the European Commission, as well as benchmarks and measurement methodologies under Art. 15(2) AIA. With this, we seek to bridge the gap between legal terminology and ML research, fostering a better alignment between research and implementation efforts.
Sources
- Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
- Towards Robust Recommendation: A Review and an Adversarial Robustness Evaluation Library
- Fairer and more accurate, but for whom?
- A Systematic Review of Robustness in Deep Learning for Computer Vision: Mind the gap?
- Gemini: A Family of Highly Capable Multimodal Models
- Machine Learning with Multi-Site Imaging Data: An Empirical Study on the Impact of Scanner Effects
- Adversarial Robustness Toolbox v1.0.0
- GPT-4 Technical Report
- Hierarchical Text-Conditional Image Generation with CLIP Latents
- Intriguing properties of neural networks
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems