Google Professional Data Engineer Exam - Topic 2 Question 8 Discussion

Actual exam question for Google's Professional Data Engineer exam

Question #: 8
Topic #: 2

[All Professional Data Engineer Questions]

You are planning to migrate your current on-premises Apache Hadoop deployment to the cloud. You need to ensure that the deployment is as fault-tolerant and cost-effective as possible for long-running batch jobs. You want to use a managed service. What should you do?

ADeploy a Cloud Dataproc cluster. Use a standard persistent disk and 50% preemptible workers. Store data in Cloud Storage, and change references in scripts from hdfs:// to gs://

BDeploy a Cloud Dataproc cluster. Use an SSD persistent disk and 50% preemptible workers. Store data in Cloud Storage, and change references in scripts from hdfs:// to gs://

CInstall Hadoop and Spark on a 10-node Compute Engine instance group with standard instances. Install the Cloud Storage connector, and store the data in Cloud Storage. Change references in scripts from hdfs:// to gs://

DInstall Hadoop and Spark on a 10-node Compute Engine instance group with preemptible instances. Store data in HDFS. Change references in scripts from hdfs:// to gs://

Show Suggested Answer

Suggested Answer: A

by Lashawnda at May 06, 2022, 03:59 AM

Limited Time Offer

25%

Off

Get Premium Professional Data Engineer Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Carma

5 months ago

B seems overkill with SSDs for batch jobs.

upvoted 0 times

...

Elena

6 months ago

Wait, why not just stick with HDFS?

upvoted 0 times

...

Cordell

6 months ago

I’m not so sure about using standard disks in A.

upvoted 0 times

...

Salena

6 months ago

Totally agree, preemptible workers save a lot!

upvoted 0 times

...

Stacey

6 months ago

A is the best option for cost-effectiveness.

upvoted 0 times

...

Dudley

6 months ago

I’m a bit confused about the SSD vs. standard disk choice. I feel like SSDs might be faster, but I’m not sure if they’re necessary for batch jobs.

upvoted 0 times

...

Annette

6 months ago

I think option A sounds familiar from our practice questions, especially with the standard persistent disk. It seems like a good balance for fault tolerance.

upvoted 0 times

...

Erin

6 months ago

I remember that using preemptible workers can save costs, but I’m not sure if they’re reliable enough for long-running jobs.

upvoted 0 times

...

Tonette

6 months ago

I recall that using managed services like Cloud Dataproc is generally recommended, but I’m not clear on why we would choose Compute Engine instances instead.

upvoted 0 times

...

Christa

6 months ago

This looks like a tricky one. I'll need to think through the Azure services and how they relate to implementing firewall and TLS inspection.

upvoted 0 times

...

Kati

6 months ago

I remember practicing a similar question regarding VPN technologies. I believe IKEv2 is more common for mobile devices, but not certain if it's the right choice here.

upvoted 0 times

...

Katina

6 months ago

Okay, let me think this through. The form seems to be related to some kind of evidence or legal process, so I'm guessing it's either a search warrant, evidence collection, or expert witness form. I'll eliminate the ones that don't seem to fit and make my best guess.

upvoted 0 times

...

Daron

6 months ago

This is a good one. I'd go with Azure Logic Apps and Azure Application Insights. The Logic Apps service can help us create the automated workflow to send the daily summary to Teams, and Application Insights can provide the exception data we need. Seems like a solid approach to me.

upvoted 0 times

...