An IS auditor examining change management procedures for an AI system observes inconsistent training data validation and verification protocols prior to model retraining. Which of the following is the MOST significant risk in this context?
When training data validation is inconsistent, the most severe risk is that the AI model may learn from incorrect, incomplete, biased, or corrupted data. This directly leads to a degradation of system reliability (option C), which manifests as inaccurate predictions, higher error rates, bias, or unstable behavior.
AAIA emphasizes that data validation prior to retraining is one of the most important controls because model behavior is fully dependent on training data integrity. If the quality and correctness of the data cannot be guaranteed, the resulting model outputs become unreliable, which can undermine compliance, operational decisions, and user trust.
Option A is less critical because increased complexity is not the core risk. Option B is important but secondary; documentation issues do not inherently degrade model reliability. Option D is an efficiency issue, not a risk to output integrity.
Therefore, compromised reliability due to poor-quality training data is the most significant risk.
AAIA Domain 2: Data Management Specific to AI (data validation, verification, data quality).
AAIA Domain 1: Governance and Risk Controls for AI.
A healthcare organization uses an AI model to analyze patient data and provide diagnostic recommendations. Which of the following MOST effectively detects data drift related to the model's predictions?
Detecting data drift is critical in maintaining the reliability and accuracy of AI models, especially in dynamic environments like healthcare where patient populations and data characteristics can change over time. According to the ISACA Advanced in AI Audit (AAIA) Study Guide, data drift refers to changes in the input data's statistical properties compared to the data on which the model was originally trained. If not detected, data drift can degrade model performance and lead to erroneous predictions.
The most effective approach to detect data drift is to continuously compare the statistical distributions of incoming (production) data with those of the training data set. This allows organizations to identify deviations in data patterns, which can be early indicators that the AI model's predictions may no longer be valid or optimal.
As stated in the AAIA Study Guide under 'AI Model Monitoring and Maintenance':
''Monitoring input data for distributional changes compared to the model's training data is an essential step in identifying data drift. Statistical tests and visualizations can help auditors and AI operators detect when the underlying data characteristics have shifted, prompting further investigation or retraining needs.''
While options such as retraining the model (option C) or adversarial testing (option D) are valuable for ongoing performance and robustness, they do not inherently detect data drift---they respond to or stress-test existing issues. Applying overrides (option B) is a human-in-the-loop safeguard, not a method for drift detection.
ISACA Advanced in AI Audit (AAIA) Study Guide, Section: 'AI Model Monitoring and Maintenance,' Subsection: 'Detection and Management of Data Drift'
An organization has introduced an AI chat system where customers can enter their preferences and the system returns the best product selections. Which of the following is the BEST way to mitigate the risk of the system providing suggestions that may upset customers?
The risk described is that customer-facing suggestions may be inappropriate, insensitive, or offensive. The BEST mitigation is to perform testing of diverse scenarios (B)---including edge cases, demographic variations, and sensitive contexts---to confirm that outputs remain within acceptable business, ethical, and customer-experience thresholds. AAIA highlights scenario-based testing and fairness/impact assessments as key practices, especially where recommendations directly influence customer interactions.
Increasing data volume (A) does not ensure fairness or sensitivity. Monitoring servers (C) focuses on technical health, not content appropriateness. Threat analysis (D) is important for security but does not directly address emotional or ethical impacts of model outputs. Therefore, structured, diverse scenario testing is the most targeted and effective approach.
ISACA, AAIA Exam Content Outline -- Domain 2 & Domain 5: Testing techniques; ethical and user-impact considerations.
ISACA AI guidance on scenario testing for fairness, appropriateness, and user impact.
When converting data categories before training an AI model, which of the following scenarios represents the GREATEST risk?
The AAIA Study Guide emphasizes that encoding categorical variables must preserve the semantic meaning and order of categories when relevant. The greatest risk occurs when ordinal data---such as customer rewards tiers---is treated as nominal through one-hot encoding, which removes the inherent order and may impair model learning.
''Improper encoding of ordinal variables as nominal can distort the model's understanding of relationships, leading to inaccurate predictions or biased outcomes.''
Customer reward categories (economy < business < first class) have a natural order. One-hot encoding ignores this order, potentially degrading model accuracy. Other options represent nominal data and are appropriately encoded.
Which of the following is MOST important to consider when auditing an organization's AI procedures?
Dorathy
9 days agoJohana
17 days agoCarylon
24 days agoPamella
1 month agoKayleigh
1 month agoNina
2 months agoVan
2 months agoSina
2 months agoKelvin
2 months agoJovita
3 months agoDean
3 months agoCarla
3 months agoKenny
3 months agoLouisa
4 months agoSage
4 months agoSommer
4 months agoMalcolm
4 months agoBrande
5 months agoMakeda
5 months agoCaitlin
5 months agoAleisha
5 months agoLorrie
6 months agoCherry
6 months agoShawnee
6 months agoGarry
6 months agoInocencia
7 months agoLawrence
7 months agoFidelia
7 months agoDorothy
7 months agoKandis
7 months agoKris
7 months agoDeeanna
9 months agoTiara
10 months agoElza
10 months ago