Deal of The Day! Hurry Up, Grab the Special Discount - Save 25% - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions

Microsoft AB-100 Exam - Topic 1 Question 12 Discussion

A company has a Microsoft Copilot Studio agent that provides answers based on a knowledge base for customer support.Users report that, occasionally, the agent provides inaccurate answers.You need to use metrics from the Analytics tab in Copilot Studio to identify the cause of the inaccuracies.Which two options should you use? Each correct answer presents part of the solution.NOTE: Each correct selection is worth one point.
B) session information and session outcomes and E) quality of generated answers
A) survey results
C) topic usage and topics with low resolution
D) engagement, resolution, and escalation rates

Microsoft AB-100 Exam - Topic 1 Question 12 Discussion

Actual exam question for Microsoft's AB-100 exam
Question #: 12
Topic #: 1
[All AB-100 Questions]

A company has a Microsoft Copilot Studio agent that provides answers based on a knowledge base for customer support.

Users report that, occasionally, the agent provides inaccurate answers.

You need to use metrics from the Analytics tab in Copilot Studio to identify the cause of the inaccuracies.

Which two options should you use? Each correct answer presents part of the solution.

NOTE: Each correct selection is worth one point.

Show Suggested Answer Hide Answer
Suggested Answer: B, E

Comprehensive and Detailed Explanation From Agentic AI Business Solutions Topics:

The correct answers are B. session information and session outcomes and E. quality of generated answers.

This scenario is focused on a knowledge base-driven Copilot Studio agent where users report that the agent sometimes gives inaccurate answers. The question asks which Analytics tab metrics should be used to identify the cause of those inaccuracies.

That means you need metrics that help you examine:

how the answer was generated

what happened in the conversation when the bad answer occurred

Why E. quality of generated answers is correct

This is the most direct metric for this scenario.

Because the agent is answering from a knowledge base, the problem is tied to the quality of the generated response itself. The quality of generated answers metric helps assess whether the generated responses are relevant, useful, and accurate enough for the user's request.

From an AI business solutions perspective, this metric is essential because it helps diagnose problems such as:

weak grounding from the knowledge source

irrelevant retrieval

poor answer formulation

hallucination-like behavior

mismatch between user question and available source content

If the issue is inaccurate answers, the first place to investigate is the quality signal tied to generated answers.

Why B. session information and session outcomes is correct

To find the cause of inaccuracies, you also need to inspect the broader conversational context. Session information and session outcomes help you see:

what the user asked

how the agent responded

whether the conversation was resolved

whether the user abandoned, escalated, or retried

where the conversation broke down

This is important because an inaccurate answer may not come only from poor generation quality. It may also come from:

the way the user phrased the request

lack of sufficient grounding context

repeated failed attempts in a session

escalation after an unhelpful answer

patterns in unsuccessful conversations

In other words, quality of generated answers tells you about answer quality, while session information and outcomes help you understand the operational context in which those inaccuracies appear.

Together, these two give the strongest diagnostic view.

Why the other options are incorrect

A . survey results

Survey results can tell you whether users were happy or unhappy, but they do not directly help identify the cause of inaccurate knowledge-based responses. They are more of a feedback signal than a root-cause metric.

C . topic usage and topics with low resolution

This is more relevant for agents built around explicit topics and topic flows. The scenario specifically describes an agent that provides answers based on a knowledge base, so generated-answer analytics are more appropriate than topic-resolution analysis.

D . engagement, resolution, and escalation rates

These are useful high-level operational KPIs, but they are not the best metrics for diagnosing why answers are inaccurate. They show outcome trends, not the direct cause of answer-quality issues.


Contribute your Thoughts:

0/2000 characters
Raymon
3 days ago
I agree, session info gives direct insights into problems.
upvoted 0 times
...
Celestine
8 days ago
Survey results could help too, but not as much as session data.
upvoted 0 times
...
Charlie
13 days ago
True, quality is crucial for trust in the agent.
upvoted 0 times
...
Mindy
18 days ago
Good point! But we also need to consider the quality of generated answers.
upvoted 0 times
...
Raymon
23 days ago
I prefer checking topic usage. Low resolution topics can highlight issues.
upvoted 0 times
...
Celestine
29 days ago
Yeah, that makes sense. It shows how users interact.
upvoted 0 times
...
Charlie
1 month ago
I think we should look at session information and outcomes.
upvoted 0 times
...
Shizue
1 month ago
Definitely need to look at survey results too!
upvoted 0 times
...
Tijuana
1 month ago
Engagement rates are important, but they don't tell the whole story.
upvoted 0 times
...
Gail
2 months ago
Surprised to see topic usage isn't mentioned more often.
upvoted 0 times
...
Patrick
2 months ago
Totally agree, but don't forget about the quality of generated answers!
upvoted 0 times
...
Peggie
2 months ago
I think session information and session outcomes are key here.
upvoted 0 times
...
Fabiola
2 months ago
I feel like survey results could be useful too, but I'm not confident if they directly relate to identifying the cause of inaccuracies.
upvoted 0 times
...
Ivette
2 months ago
I practiced a similar question before, and I think engagement and resolution rates are crucial. They might show us how often users are satisfied with the answers.
upvoted 0 times
...
Wenona
3 months ago
I'm not entirely sure, but I remember something about topic usage being important. Maybe options C and E could help us understand the inaccuracies?
upvoted 0 times
...
Anglea
3 months ago
I think we should look at session information and session outcomes. It seems like a good way to track where things go wrong.
upvoted 0 times
...

Save Cancel