A team is preparing to evaluate an agent in Copilot Studio before expanding access to additional users.
The team must select an evaluation method that meets the following requirements:
Use a fixed set of prepared interactions.
Determine responses against a predefined baseline.
Support consistent comparison across repeated test runs.
You need to choose an evaluation method that meets the requirements.
What should you do?
A standardized evaluation matrix is the appropriate choice because it establishes fixed test inputs, expected responses, and consistent scoring criteria. In Copilot Studio, this approach is implemented by creating a reusable test set containing prepared test cases and applying appropriate evaluation methods to each case.
The predefined baseline can consist of expected answers, required keywords, expected tool usage, or custom quality criteria. Depending on the required precision, the team can use exact match, text similarity, compare meaning, keyword match, tool-use, or custom evaluation methods. Copilot Studio records the generated response and evaluates it against the configured expectation, producing repeatable scores and pass-or-fail results.
The same test set can be executed multiple times and the resulting runs compared. This provides an objective way to detect regressions after changes to instructions, topics, knowledge sources, tools, or models. A limited live pilot measures production outcomes but does not provide tightly controlled inputs. Manual transcript reviews and relying on a previous run are subjective and do not establish repeatable evaluation criteria.
A company is configuring an agent in Copilot Studio that uses a generative answers node inside multiple topics.
The company requires responses to meet the following requirements:
Must use an executive summary format.
Must apply only within a specific topic.
Must continue using configured knowledge sources.
Must comply with connector security controls.
You need to configure a custom prompt to meet the formatting requirements.
Solution: Remove the generative answers node and rely only on the custom prompt to produce formatted responses.
Does the solution meet the goal?
Comprehensive and Detailed Explanation From Microsoft AB-620 Study Guide: Removing the generative answers node eliminates the component that searches the configured knowledge sources and produces the grounded topic response. A standalone custom prompt can format or transform supplied input, but it does not automatically inherit the topic's selected knowledge sources or reproduce the node's retrieval behavior. The resulting answer could therefore have the requested executive-summary style while failing the grounding requirement. The correct design retains the generative answers node and applies topic-scoped custom instructions to its response, or captures the grounded output in a variable and sends that content through a carefully configured formatting prompt. General knowledge should remain disabled when the topic must use only approved enterprise sources. Connector security and data policies continue to govern the actual source connections and cannot be replaced by prompt text. The proposed removal is consequently not a valid solution. Validation should inspect the retrieved sources, generated answer, final format, and behavior when no authorized source returns relevant content. Study Guide alignment: Plan and configure agent solutions > Configure topics > Configure generative answers node; Configure advanced agent responses with custom prompts.
===============
You need to ensure that performance-related questions are handled in accordance with Fabrikam Inc.'s defined architecture and business requirements
Which capability should Operations Concierge use?
Comprehensive and Detailed Explanation From Microsoft AB-620 Study Guide: A Fabric Data Agent is the capability designed for questions that must be answered from governed analytical data. Fabrikam's backlog, SLA-risk, parts-shortage, and dispatch-delay measures already reside behind a Fabric semantic model, so delegating these requests to the data agent preserves the business definitions, relationships, and security applied in Fabric. The result can be returned in a structured form suitable for weekly operational review rather than being estimated from general model knowledge. A Foundry agent is already assigned to summarization and classification of long-form text; it is not the authoritative source for operational KPIs. An MCP server is appropriate when the user must perform a transaction, such as creating a parts request, but the question asks for performance information rather than an update. Azure AI Search supports document retrieval for policies and procedures, not calculation over the Fabric semantic model. The primary agent's description for the Fabric specialist should explicitly mention the supported metrics so generative orchestration consistently delegates those requests instead of attempting an unsupported generative answer. Study Guide alignment: Integrate and extend agents in Copilot Studio > Configure multi-agent collaboration from Copilot Studio > Integrate a Fabric data agent.
===============
A company is configuring an agent in Copilot Studio that uses a generative answers node inside multiple topics.
The company requires responses to meet the following requirements.
* Must use an executive summary format
* Must apply only within a specific topic.
* Must continue using configured knowledge sources.
* Must comply with connector security controls.
You need to configure a custom prompt to meet the formatting requirements
Solution: Create a custom prompt tool in the specific topic that instructs the model to respond using an executive-summary structure.
Does the solution meet the goal?
Comprehensive and Detailed Explanation From Microsoft AB-620 Study Guide: A separate custom prompt tool that merely requests an executive-summary structure does not, by itself, guarantee that the existing generative answers node and its configured knowledge sources remain in the response path. Prompt tools have their own inputs, knowledge configuration, model settings, and completion behavior. If the tool is invoked independently, it can generate correctly formatted text without using the sources selected for the topic's generative answer, which violates a stated requirement. The safer design is to keep the generative answers node and apply topic-specific custom instructions or prompt modification to that node, or explicitly pass its grounded output into a downstream formatting prompt with a controlled contract. Connector security remains enforced by the underlying connections and data policies; wording in a prompt cannot override those controls. Therefore, the proposed solution is incomplete and does not meet the goal as written. Testing should confirm not only the output format but also the sources used and the identity under which any connector retrieval occurred. Study Guide alignment: Plan and configure agent solutions > Configure topics > Configure advanced agent responses with custom prompts and custom knowledge sources.
===============
A company is deploying an agent for employees. The company has the following requirements:
* Access must be restricted to the internal employees only.
* End-user authentication must be enforced.
You need to configure the agent based on the company requirements. What should you do?
Comprehensive and Detailed Explanation From Microsoft AB-620 Study Guide: Selecting Authenticate with Microsoft restricts the agent to signed-in organizational identities in the supported Microsoft channel and enables the agent to be shared with controlled users in the tenant. That meets the requirement for internal employees and enforced end-user authentication. No authentication or a public website would allow anyone with access to the link to converse with the agent and would prevent reliable organizational access control. A personal-account setting is not the enterprise identity model required here. Authentication and authorization are related but separate: after choosing Microsoft authentication, the owner must still share the agent only with the intended employees or groups and ensure connected knowledge and tools apply the user's permissions correctly. If the deployment uses a channel that requires manual Entra ID configuration, the appropriate manual authentication and sign-in requirement may be needed instead; however, among the supplied choices, Authenticate with Microsoft is the correct control. Test with authorized, unauthorized, and signed-out users before release, and review any DLP policy that mandates authentication. Study Guide alignment: Plan and configure agent solutions > Plan an agent solution > Plan identity strategy; Design agents for internal audiences.
===============
Thomas Laurent
12 hours agoDavid Hall
16 days agoUmar Aziz
17 days agoYan Liu
1 month agoAisha Islam
2 months agoNisha Kumar
2 months agoAlejandro Berg
2 months agoRizwan Mirza
3 months agoJessica Young
3 months ago