Deal of The Day! Hurry Up, Grab the Special Discount - Save 25% - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions

Amazon MLA-C01 Exam - Topic 2 Question 16 Discussion

An ML engineer is using Amazon SageMaker Canvas to build a custom ML model from an imported dataset. The model must make continuous numeric predictions based on 10 years of data.Which metric should the ML engineer use to evaluate the model's performance?
D) Root Mean Square Error (RMSE)
A) Accuracy
B) InferenceLatency
C) Area Under the ROC Curve (AUC)

Amazon MLA-C01 Exam - Topic 2 Question 16 Discussion

Actual exam question for Amazon's MLA-C01 exam
Question #: 16
Topic #: 2
[All MLA-C01 Questions]

An ML engineer is using Amazon SageMaker Canvas to build a custom ML model from an imported dataset. The model must make continuous numeric predictions based on 10 years of data.

Which metric should the ML engineer use to evaluate the model's performance?

Show Suggested Answer Hide Answer
Suggested Answer: D

This is a regression problem, where the target variable is continuous and numeric. AWS documentation clearly states that classification metrics such as accuracy and AUC are not appropriate for regression models.

Root Mean Square Error (RMSE) measures the square root of the average squared differences between predicted and actual values. RMSE penalizes larger errors more heavily, making it especially useful when large prediction errors are costly or undesirable.

SageMaker Canvas automatically selects regression metrics such as RMSE and MAE when building regression models. RMSE is widely used for time-based and numeric prediction problems, especially when evaluating long historical datasets.

Inference latency measures system performance, not model accuracy.

Therefore, Option D is the correct and AWS-verified answer.


Contribute your Thoughts:

0/2000 characters
Miriam
26 days ago
Totally agree, accuracy isn't suitable here.
upvoted 0 times
...
Thaddeus
1 month ago
RMSE is the best choice for continuous predictions!
upvoted 0 times
...
Refugia
2 months ago
I feel like accuracy might not apply here, but I'm confused about the other options. RMSE sounds right, but what about inference latency?
upvoted 0 times
...
Reyes
2 months ago
I practiced a similar question, and I believe RMSE is the standard metric for evaluating continuous predictions.
upvoted 0 times
...
Georgene
2 months ago
I'm not entirely sure, but I remember something about AUC being more relevant for classification tasks.
upvoted 0 times
...
Leandro
2 months ago
I think we should focus on metrics for regression since we're predicting continuous values. RMSE seems like a good choice.
upvoted 0 times
...

Save Cancel