Operationalizing Machine Learning and Generative AI Solutions (beta) Questions and Answers
You need to standardize how Fabrikam Inc. manages machine learning assets.
Which action should you perform first?
You need to isolate training workloads while remaining cost-aware to address Fabrikam Inc.’s issues, constraints, and technical requirements.
What should you implement?
You need to recommend an experiment-tracking strategy that ensures consistent experiment results.
What should you recommend?
Note: This question is part of a series of questions that present the same scenario. Each question in the series contains a unique solution that might meet the stated goals. Some question sets might have more than one correct solution, while others might not have a correct solution.
After you answer a question in this section, you will NOT be able to return to it. As a result, these questions will not appear on the review screen.
You work in Microsoft Foundry with a prompt flow.
You must manually evaluate prompts and compare results across prompt variants.
You need to capture the inputs, outputs, token usage, and latencies for each flow run for the evaluation.
Solution: Use the prompt flow SDK to enable tracing for the flow before executing runs. Then run the flow to generate traceable results.
Does the solution meet the goal?
You are monitoring a fine-tuned large language model deployed in Microsoft Foundry.
You evaluate the model before and after fine-tuning by using the same evaluation dataset.
You review the following evaluation results:

You need to determine whether the fine-tuned model shows improved performance without introducing regression.
For each of the following statements, select Yes if the statement is true. Otherwise, select No. NOTE: Each correct selection is worth one point.

A company is creating an internal tool that summarizes long meeting transcripts and extracts action items.
The model must:
Process text inputs up to 200k tokens long.
Generate concise summaries in seconds.
Support interactive testing before integration into the app.
You need to select, deploy, and test a model that supports summarization with low latency.
How should you complete the configuration plan? To answer, select the appropriate options in the answer area . NOTE: Each correct selection is worth one point.

A team plans to deploy a large foundation model in Microsoft Foundry as part of a new enterprise AI capability.
Different business units across the team ' s organization will access the model from various internal applications.
You need to deploy a foundation model by minimizing latency.
Which deployment type should you use?
A team manages an Azure Machine Learning workspace and deploys a model to an endpoint.
A deployed online endpoint shows inconsistent response times during periods of high traffic.
You need to identify potential performance degradation.
Which three metrics should you monitor? Each correct answer presents part of the solution. NOTE: Each correct selection is worth one point. Choose three
An Azure Machine Learning workspace contains multiple registered versions of a model that is used in production.
An older model version must no longer be deployable, but it must remain available for compliance review and potential rollback.
You need to change the state of the model version to meet the requirements.
What should you do?



