You have data pipelines running on BigQuery, Cloud Dataflow, and Cloud Dataproc. You need to perform health checks and monitor their behavior, and then notify the team managing the pipelines if they fail. You also need to be able to work across multiple projects. Your preference is to use managed products of features of the platform. What should you do?
Suggested Answer: B
Get Premium Professional Data Engineer Questions
as Interactive Web-Based Practice Test or PDF
Real Exam Format
Detailed Explanations
Instant Access
Get Your Practice Test
31 comments · newest first
VA
Vallie
6 months ago
A keeps it simple and effective. We need reliability!
PA
Paz
6 months ago
D sounds too manual. I prefer automated solutions.
JA
Jacinta
7 months ago
I like C, but it feels a bit complex with multiple steps.
JE
Jeanice
7 months ago
Option B is interesting, but managing VMs is extra work.
RY
Ryan
7 months ago
I agree, A seems straightforward. Alerts are crucial.
CE
Cecily
7 months ago
I think option A is the best. Stackdriver is great for monitoring.
IS
Isadora
7 months ago
Wait, can you really use Stackdriver for this? I thought it was just for monitoring!
LI
Lili
8 months ago
D) seems like too much work for a simple notification.
MI
Mitsue
8 months ago
C) sounds complicated, why not just use A)?
AL
Alexis
8 months ago
I think B) is overkill for this task.
GA
Gabriele
8 months ago
A) Stackdriver is the way to go. Gotta love those managed services!
BR
Brett
9 months ago
Haha, who still uses email these days? I'd go with a Slack or Teams integration instead.
CA
Carolann
9 months ago
D) Developing an App Engine app to handle this seems like overkill. Why not use a managed service?
YE
Yen
9 months ago
Developing an App Engine app sounds like a lot of work, and I’m not sure if it’s the best approach compared to the other options.
WI
Willow
9 months ago
I feel like exporting logs to BigQuery could work, but setting up App Engine seems like an extra step that might not be necessary.
YO
Yolando
9 months ago
I'm not entirely sure, but I think using a VM with Airflow might complicate things, especially since we want managed solutions.
SO
Soledad
9 months ago
I remember we discussed using Stackdriver for monitoring in one of our practice sessions, so option A sounds familiar.
AG
Agustin
10 months ago
Option B with Airflow running on a VM could work, but it might be overkill for this use case. I'd probably go with Stackdriver as well.
SH
Shannan
10 months ago
Option C looks interesting, but I'm not sure if exporting logs to BigQuery and then using App Engine is the most efficient approach. Stackdriver might be simpler.
KI
Kimberlie
10 months ago
C) Exporting to BigQuery and using App Engine seems like a good way to leverage the platform.
LE
Lezlie
10 months ago
A) is the easiest way to set up alerts.
JU
Junita
10 months ago
A) Sounds like the easiest and most managed solution. I like it.
NO
Nohemi
11 months ago
B) Running Airflow on a VM? That's a lot of work when there are simpler options.
VI
Vince
11 months ago
I like the idea of using a managed service like Stackdriver. Option A seems like the most straightforward solution to meet the requirements.
LO
Louvenia
11 months ago
I'm a little confused by the question. Do we need to monitor across multiple projects? If so, option D might be better since we can use the GCP APIs to pull data from different projects.
BR
Brock
11 months ago
I think I'd go with option A. Stackdriver seems like the easiest way to monitor the pipelines and set up alerts.
MA
Mary
5 months ago
Yeah, less hassle with Stackdriver. Let's go for it!
AL
Almeta
6 months ago
Option A is definitely the most managed solution.
KA
Kattie
6 months ago
I like the idea of alerts. Keeps everything in check.
RE
Renay
6 months ago
Stackdriver is pretty reliable for monitoring. Good choice!
SY
Sylvia
6 months ago
I agree, option A sounds straightforward.