IAPP AIGP Exam - Topic 1 Question 29 Discussion

CASE STUDYPlease use the following answer the next question:ABC Corp, is a leading insurance provider offering a range of coverage options to individuals. ABC has decided to utilize artificial intelligence to streamline and improve its customer acquisition and underwriting process, including the accuracy and efficiency of pricing policies.ABC has engaged a cloud provider to utilize and fine-tune its pre-trained, general purpose large language model (''LLM''). In particular, ABC intends to use its historical customer data---including applications, policies, and claims---and proprietary pricing and risk strategies to provide an initial qualification assessment of potential customers, which would then be routed .. human underwriter for final review.ABC and the cloud provider have completed training and testing the LLM, performed a readiness assessment, and made the decision to deploy the LLM into production. ABC has designated an internal compliance team to monitor the model during the first month, specifically to evaluate the accuracy, fairness, and reliability of its output. After the first month in production, ABC realizes that the LLM declines a higher percentage of women's loan applications due primarily to women historically receiving lower salaries than men.During the first month when ABC monitors the model for bias, it is most important to?

A) Continue disparity testing.

B) Analyze the quality of the training and testing data.

C) Compare the results to human decisions prior to deployment.

D) Seek approval from management for any changes to the model.

IAPP AIGP Exam - Topic 1 Question 29 Discussion

Actual exam question for IAPP's AIGP exam

Question #: 29
Topic #: 1

[All AIGP Questions]

CASE STUDY

Please use the following answer the next question:

ABC Corp, is a leading insurance provider offering a range of coverage options to individuals. ABC has decided to utilize artificial intelligence to streamline and improve its customer acquisition and underwriting process, including the accuracy and efficiency of pricing policies.

ABC has engaged a cloud provider to utilize and fine-tune its pre-trained, general purpose large language model (''LLM''). In particular, ABC intends to use its historical customer data---including applications, policies, and claims---and proprietary pricing and risk strategies to provide an initial qualification assessment of potential customers, which would then be routed .. human underwriter for final review.

ABC and the cloud provider have completed training and testing the LLM, performed a readiness assessment, and made the decision to deploy the LLM into production. ABC has designated an internal compliance team to monitor the model during the first month, specifically to evaluate the accuracy, fairness, and reliability of its output. After the first month in production, ABC realizes that the LLM declines a higher percentage of women's loan applications due primarily to women historically receiving lower salaries than men.

During the first month when ABC monitors the model for bias, it is most important to?

AContinue disparity testing.

BAnalyze the quality of the training and testing data.

CCompare the results to human decisions prior to deployment.

DSeek approval from management for any changes to the model.

Show Suggested Answer

Suggested Answer: A

During the first month of monitoring the model for bias, it is most important to continue disparity testing. Disparity testing involves regularly evaluating the model's decisions to identify and address any biases, ensuring that the model operates fairly across different demographic groups.

by Tiffiny at Jun 13, 2025, 07:36 AM

Limited Time Offer

25%

Off

Get Premium AIGP Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Hobert

9 months ago

Not sure if seeking management approval will solve the bias issue.

upvoted 0 times

...

Boris

9 months ago

Wait, are they really using historical data that could be biased?

upvoted 0 times

...

Alpha

9 months ago

Sounds like a classic case of bias in AI.

upvoted 0 times

...

Quentin

9 months ago

Definitely need to compare results to human decisions first!

upvoted 0 times

...

France

10 months ago

I think analyzing the training data is crucial here.

upvoted 0 times

...

Kathrine

10 months ago

I feel like seeking management approval for changes could be important, but it seems like we should focus on the model's performance first.

upvoted 0 times

...

Samira

10 months ago

I'm leaning towards continuing disparity testing since we need to address the bias issue quickly, but I'm not completely confident.

upvoted 0 times

...

Gene

10 months ago

I think we practiced a similar question where we had to evaluate model outputs against human decisions. That might be relevant here too.

upvoted 0 times

...

Elmer

11 months ago

I remember we discussed the importance of analyzing training data quality in class, but I'm not sure if that's the most critical step right now.

upvoted 0 times

...

Malcolm

11 months ago

Hmm, I'm not sure seeking approval from management is the right move here. We need to be proactive in fixing this issue before it causes any further harm.

upvoted 0 times

...

Leatha

11 months ago

I feel pretty confident about this one. Comparing the model's decisions to the previous human decisions seems like the most straightforward way to identify and address the bias.

upvoted 0 times

...

Rosendo

11 months ago

I'm a bit confused on the best approach here. Should we just continue testing for disparities, or is there something more proactive we can do to address the issue?

upvoted 0 times

...

Berry

11 months ago

Okay, I think the key here is to focus on the quality and fairness of the training data. We need to make sure there aren't any inherent biases or imbalances that are getting reflected in the model's decisions.

upvoted 0 times

...

Krystina

11 months ago

Hmm, this seems like a tricky one. I'll need to carefully analyze the data and model to identify the source of the bias against women's applications.

upvoted 0 times

...

Mitsue

1 year ago

We should also compare the results to human decisions for validation.

upvoted 0 times

...

Glory

1 year ago

Hah, approval from management? Good luck with that. They're probably the ones who introduced the bias in the first place!

upvoted 0 times

Janine

1 year ago

C: Compare the results to human decisions prior to deployment.

upvoted 0 times

...

Marylin

1 year ago

B: Analyze the quality of the training and testing data.

upvoted 0 times

...

Maryann

1 year ago

A: Continue disparity testing.

upvoted 0 times

...

Veronika

1 year ago

I agree with Hoa, it's crucial to monitor for bias in the model.

upvoted 0 times

...

Franchesca

1 year ago

I'd go with C. Comparing to human decisions is key, but don't forget to cover your you-know-what and get management approval too.

upvoted 0 times

Margery

1 year ago

D) Seek approval from management for any changes to the model.

upvoted 0 times

...

Yvonne

1 year ago

C) Compare the results to human decisions prior to deployment.

upvoted 0 times

...

Hoa

1 year ago

I think we should continue disparity testing to ensure fairness.

upvoted 0 times

...

Jeannetta

1 year ago

Comparing the results to human decisions is crucial. That'll show if the model is actually an improvement or just perpetuating existing biases.

upvoted 0 times

...

Dannie

1 year ago

Definitely need to analyze the quality of the training and testing data. If there's bias in the historical data, the model will just reflect that. Gotta get to the root of the issue.

upvoted 0 times