Google Exam Professional Data Engineer Topic 3 Question 83 Discussion

Actual exam question for Google's Professional Data Engineer exam

Question #: 83
Topic #: 3

[All Professional Data Engineer Questions]

You need to modernize your existing on-premises data strategy. Your organization currently uses.

* Apache Hadoop clusters for processing multiple large data sets, including on-premises Hadoop Distributed File System (HDFS) for data replication.

* Apache Airflow to orchestrate hundreds of ETL pipelines with thousands of job steps.

You need to set up a new architecture in Google Cloud that can handle your Hadoop workloads and requires minimal changes to your existing orchestration processes. What should you do?

AUse Dataproc to migrate Hadoop clusters to Google Cloud, and Cloud Storage to handle any HDFS use cases Convert your ETL pipelines to Dataflow.

BUse Bigtable for your large workloads, with connections to Cloud Storage to handle any HDFS use cases Orchestrate your pipelines with Cloud Composer.

CUse Dataproc to migrate your Hadoop clusters to Google Cloud, and Cloud Storage to handle any HDFS use cases. Use Cloud Data Fusion to visually design and deploy your ETL pipelines.

DUse Dataproc to migrate Hadoop clusters to Google Cloud, and Cloud Storage to handle any HDFS use cases. Orchestrate your pipelines with Cloud Composer..

Show Suggested Answer

Suggested Answer: C

by Benton at May 12, 2024, 01:23 PM

Limited Time Offer

25%

Off

Get Premium Professional Data Engineer Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Lenora

19 days ago

I gotta say, these cloud services are really starting to sound like they were named by a team of engineers high on caffeine. 'Dataproc'? 'Cloud Composer'? I feel like I need a PhD in Google Cloud just to understand the question!

upvoted 0 times

...

Gerald

20 days ago

Wow, this is a tough one! I'm tempted to go with Option A just to keep things simple, but Option C seems like it offers the most comprehensive modernization. 'When in doubt, go with the most features!' - that's my motto!

upvoted 0 times

...

Chantell

25 days ago

Option B is an interesting approach, but I'm not sure Bigtable is the best fit for the large workloads mentioned in the question. I'd probably go with Option C for its more holistic solution.

upvoted 0 times

...

Anisha

1 months ago

I'm leaning towards Option D. Using Dataproc and Cloud Composer seems like a straightforward approach that aligns well with the existing orchestration processes.

upvoted 0 times

Linn

10 days ago

Dataproc and Cloud Composer seem like a reliable combination for this migration.

upvoted 0 times

...

Evangelina

27 days ago

I agree, sticking with what you know can make the transition smoother.

upvoted 0 times

...

Amber

1 months ago

Option D sounds like a good choice. It keeps things simple and aligned with what you already have in place.

upvoted 0 times

...

Edward

2 months ago

Option C looks like the most comprehensive solution. Migrating Hadoop to Dataproc and using Cloud Storage for HDFS, while leveraging Cloud Data Fusion for visual ETL design, seems like a great way to modernize the architecture with minimal changes.

upvoted 0 times