Amazon Exam AIF-C01 Topic 3 Question 20 Discussion

Actual exam question for Amazon's AIF-C01 exam

Question #: 20
Topic #: 3

A company is building a large language model (LLM) question answering chatbot. The company wants to decrease the number of actions call center employees need to take to respond to customer questions.

Which business objective should the company use to evaluate the effect of the LLM chatbot?

AWebsite engagement rate

BAverage call duration

CCorporate social responsibility

DRegulatory compliance

Show Suggested Answer

Suggested Answer: C

Experimenting and refining the prompt is the best approach to ensure that the chatbot using a foundation model (FM) produces responses that adhere to the company's tone.

Prompt Engineering:

Adjusting and refining the prompt allows for better control over the FM's outputs, ensuring they align with the desired tone and style.

This iterative process involves testing different prompts and modifying them based on the model's responses to achieve the desired outcome.

Why Option C is Correct:

Directly Influences Output Quality: Allows for fine-tuning of the model's responses to match the company's tone.

Cost-Effective: Does not require modifying the model itself, only the inputs to it.

Why Other Options are Incorrect:

A . Low limit on tokens: Limits response length but not the adherence to company tone.

B . Batch inferencing: Relates to processing multiple inputs, not controlling response tone.

D . Higher temperature: Increases randomness in responses, which could deviate from the desired tone.

by Abraham at Mar 09, 2025, 04:19 AM

Limited Time Offer

25%

Off

Get Premium AIF-C01 Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Veronika

22 days ago

As a professional AI engineer, I must say that the correct answer is B) Average call duration. Anything else would be a complete waste of time and resources. Unless, of course, you're planning to use the chatbot to write poetry and win literary awards. In that case, go for C) Corporate social responsibility.

upvoted 0 times

...

Trinidad

1 months ago

Clearly, the answer is A) Website engagement rate. I mean, if the chatbot is so good, people are gonna be flocking to the website to use it, right? It's a no-brainer!

upvoted 0 times

Linette

7 days ago

D: Definitely, it would be a clear measure of the chatbot's impact on website traffic.

upvoted 0 times

...

Kati

9 days ago

C: I agree, it's a good indicator of customer interest and satisfaction.

upvoted 0 times

...

Karma

26 days ago

B: Yeah, that makes sense. It would show how effective the chatbot is at attracting users.

upvoted 0 times

...

Lacresha

1 months ago

A: I think the company should use Website engagement rate to evaluate the chatbot.

upvoted 0 times

...

Shakira

1 months ago

Hold up, I'm going with D) Regulatory compliance. You can't just implement an AI system without making sure it adheres to all the rules and regulations, right? Don't want any lawsuits here!

upvoted 0 times

...

Jaime

2 months ago

Hmm, I was thinking C) Corporate social responsibility. You know, the chatbot could help the company improve its image and be more responsive to customers.

upvoted 0 times

Dustin

23 days ago

I agree with you, B) Average call duration is a more direct measure of the chatbot's impact on call center efficiency.

upvoted 0 times

...

Trina

30 days ago

I think B) Average call duration would be a better measure. The chatbot should aim to reduce the time employees spend on calls.

upvoted 0 times

...

Vernice

2 months ago

I think the answer is B) Average call duration. The goal is to decrease the number of actions call center employees need to take, so that should translate to shorter call times.

upvoted 0 times

Vonda

15 days ago

That's a good point. I still think B) Average call duration is the best choice for evaluating the chatbot's effectiveness.

upvoted 0 times

...

Penney

24 days ago

I think website engagement rate is more about how users interact with the website, not necessarily about call center efficiency.

upvoted 0 times

...

Shawnee

1 months ago

But what about A) Website engagement rate? Wouldn't that also be important for measuring the success of the chatbot?

upvoted 0 times

...

Krissy

1 months ago

I agree, B) Average call duration makes the most sense for evaluating the chatbot's impact.

upvoted 0 times

...

Celestina

2 months ago

But what about website engagement rate? Wouldn't that also show the impact of the chatbot?

upvoted 0 times

...

Margery

2 months ago

I agree with Margerybie. If the chatbot is effective, call duration should decrease.

upvoted 0 times

...

Bobbie

2 months ago

I think the company should use average call duration to evaluate the chatbot.

upvoted 0 times

...