MENU
Which of the following poses the GREATEST challenge when performing root cause analysis for incidents involving AI systems and data?
Root cause analysis for AI incidents requires the ability to trace system behavior back through decision logic, data processing steps, and model internals to identify what caused the incident. AI systems---particularly deep learning models---often operate as black boxes, making this tracing extremely difficult.
Why A is Correct: According to ISACA AAIR incident management guidance, the lack of transparency in AI systems is the greatest root cause analysis challenge. When decision logic cannot be inspected, when data lineage is unclear, or when model internals are opaque, analysts cannot determine why the system behaved as it did. This transparency deficit prevents accurate root cause identification, perpetuates recurrence, and makes it impossible to demonstrate corrective action to regulators.
Why B is Wrong: Unclear system objectives represent a design and governance problem that should be addressed before deployment. While unclear objectives can contribute to incidents, they are typically knowable and addressable. Lack of transparency during an incident is a more immediate analytical barrier.
Why C is Wrong: Automation bias---the tendency to over-trust automated systems---is a human factors risk that affects decision-making during normal operations. While it may contribute to incidents, it is a behavioral phenomenon rather than the primary technical barrier to root cause analysis.
Why D is Wrong: Privacy compliance requirements may restrict access to certain data needed for analysis, creating constraints on investigation. However, these are governance constraints that can often be addressed through appropriate authorization, not fundamental analytical barriers.