Halloween Special 2026! Get Up to 25% OFF Practice Questions! Limited Time - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions

Microsoft AI-103 Exam - Topic 5 Question 1 Discussion

Posted by Shantay on Jun 01, 2026 at 04:13 PM

You have a Microsoft Foundry project that uses Azure Al Search to ground an agent in internal documentation.

After a recent content update, users report that the agent's answers have become less accurate.

You need to identify whether the retrieved content is negatively influencing the model's generated responses.

Which observability signal should you review?

Suggested Answer: B

The correct observability signal is B. groundedness evaluation metrics. In a RAG solution, the key diagnostic question is whether the generated answer is supported by the retrieved context. Microsoft Foundry's built-in evaluator reference defines Groundedness as the metric that measures how grounded the response is in the retrieved context, with scoring that indicates whether the model's claims are supported by the provided source material.

This matches the issue after a content update. If retrieved chunks are stale, misleading, incomplete, or poorly aligned with the user query, groundedness results can show that generated responses are not reliably supported by the retrieved documentation. The RAG evaluator guidance explains that groundedness focuses on whether the response avoids content outside the grounding context, while other process metrics such as retrieval evaluate how relevant the retrieved chunks are. Latency traces are useful for performance troubleshooting, not response accuracy. Indexer status can reveal ingestion failures, but it does not show whether retrieved content is influencing generated answers negatively. Prediction drift is a model monitoring concept and is not the primary signal for RAG grounding quality. Reference topics: Microsoft Foundry observability, RAG evaluators, groundedness, retrieved context, and response quality evaluation.


Get Premium AI-103 Questions as Interactive Web-Based Practice Test or PDF Real Exam Format Detailed Explanations Instant Access Get Your Practice Test
17 comments · newest first
KI
Kizzy 1 month ago
Let's prioritize prediction drift metrics first, then groundedness.
EL
Elli 1 month ago
Exactly, we need to focus on how content affects predictions.
ON
Ona 1 month ago
Indexer status might show if there's a failure, but not accuracy.
RA
Ranee 2 months ago
Latency breakdown traces won't help with accuracy issues.
TA
Tabetha 2 months ago
True, but I feel prediction drift is more direct.
CA
Carmelina 2 months ago
Groundedness evaluation metrics could also help.
KI
Kizzy 2 months ago
Agreed, prediction drift metrics show how the model's accuracy changes.
EL
Elli 2 months ago
I think we should check the prediction drift metrics.
TI
Timothy 3 months ago
Latency breakdown traces might help too, just saying!
EN
Enola 3 months ago
Not sure if the content update is the real issue, could be something else.
PO
Portia 3 months ago
Wait, isn't prediction drift metrics also important?
EL
Elke 3 months ago
Totally agree, that makes the most sense here.
MO
Monroe 3 months ago
I think we should check the groundedness evaluation metrics.
LO
Louisa 3 months ago
Latency breakdown traces seem less relevant here; I think we should focus on how the content is affecting the responses, which might point us back to groundedness metrics.
RO
Roy 4 months ago
I practiced a similar question where we had to assess the impact of content changes, and I feel like groundedness evaluation metrics were the right choice there too.
TH
Thaddeus 4 months ago
I'm not entirely sure, but I remember something about prediction drift metrics being important for understanding changes in model accuracy after updates.
AS
Asha 4 months ago
I think we might need to look at the groundedness evaluation metrics since they directly relate to how well the agent is using the internal documentation.
0/2000 characters

Save Cancel