Discuss Isaca AAIA Exam Topic 1 Question 14

An organization has introduced an AI chat system where customers can enter their preferences and the system returns the best product selections. Which of the following is the BEST way to mitigate the risk of the system providing suggestions that may upset customers?

AIncrease the volume of training data to ensure the data set is fair and impartial.

BPerform testing of diverse scenarios to confirm outputs are within the acceptable range.

CImplement continuous monitoring of AI servers to detect anomalies in technical performance.

DConduct threat analysis to identify unknown exposures.

Suggested Answer: B

The risk described is that customer-facing suggestions may be inappropriate, insensitive, or offensive. The BEST mitigation is to perform testing of diverse scenarios (B)---including edge cases, demographic variations, and sensitive contexts---to confirm that outputs remain within acceptable business, ethical, and customer-experience thresholds. AAIA highlights scenario-based testing and fairness/impact assessments as key practices, especially where recommendations directly influence customer interactions.

Increasing data volume (A) does not ensure fairness or sensitivity. Monitoring servers (C) focuses on technical health, not content appropriateness. Threat analysis (D) is important for security but does not directly address emotional or ethical impacts of model outputs. Therefore, structured, diverse scenario testing is the most targeted and effective approach.

ISACA, AAIA Exam Content Outline -- Domain 2 & Domain 5: Testing techniques; ethical and user-impact considerations.

ISACA AI guidance on scenario testing for fairness, appropriateness, and user impact.

Get Premium AAIA Questions as Interactive Web-Based Practice Test or PDF Real Exam Format Detailed Explanations Instant Access Get Your Practice Test

26 comments · newest first

Justine 1 month ago

D is useful for risks, but we need to focus on customer experience.

Carlton 1 month ago

C could help, but it’s more about performance, not suggestions.

Colby 2 months ago

I agree, but A seems important too. Fair data matters.

Alberta 2 months ago

I think B is the best choice. Testing scenarios is crucial.

Jesusita 2 months ago

D seems less relevant. We should focus on immediate customer experience.

Jordan 2 months ago

C is important for ongoing performance. We need to catch issues early.

Marvel 2 months ago

I agree, but A could help too. More data means better fairness.

Melvin 2 months ago

I think B is the best choice. Testing scenarios is crucial.

Omer 3 months ago

C is vital for ongoing performance, but initial testing is key.

Tabetha 3 months ago

A is important too, but without testing, it might still fail.

Kristeen 3 months ago

Agreed! It ensures the system understands various customer preferences.

Odette 3 months ago

I think B is the best choice. Testing diverse scenarios is crucial.

Tamala 3 months ago

Not sure if more data alone can fix the problem.

Buddy 4 months ago

Totally agree with B! We need to cover all scenarios.

Nancey 5 months ago

Surprised that D isn't getting more attention! Threat analysis is crucial.

Lennie 5 months ago

I think A is important too, but not the best choice here.

Desire 5 months ago

B is definitely the way to go! Testing is key.

Darrin 6 months ago

D sounds interesting, but is it really necessary?

Sabina 6 months ago

A larger dataset won't fix biased outputs.

Telma 6 months ago

Wait, how can we be sure the testing covers everything?

Harris 6 months ago

I agree, testing diverse scenarios is key!

Dortha 6 months ago

B seems like the best option to ensure quality.

Veta 6 months ago

Threat analysis sounds important, but I feel like it might be more about security than customer satisfaction. I guess I need to review that part again.

Jamal 7 months ago

I think continuous monitoring is crucial, but I wonder if it would catch all the potential issues. Maybe a combination of options would be best?

Devon 7 months ago

I'm not entirely sure, but I think increasing the training data might not be enough on its own. It feels like we need to look at how the AI performs in real situations too.

Katie 7 months ago

I remember we discussed the importance of testing diverse scenarios in class. It seems like option B could really help ensure the AI doesn't upset customers.

Isaca AAIA Exam - Topic 1 Question 14 Discussion