MENU
You need to modernize your existing on-premises data strategy. Your organization currently uses.
* Apache Hadoop clusters for processing multiple large data sets, including on-premises Hadoop Distributed File System (HDFS) for data replication.
* Apache Airflow to orchestrate hundreds of ETL pipelines with thousands of job steps.
You need to set up a new architecture in Google Cloud that can handle your Hadoop workloads and requires minimal changes to your existing orchestration processes. What should you do?
Suggested Answer: C
Get Premium Professional Data Engineer Questions
as Interactive Web-Based Practice Test or PDF
Real Exam Format
Detailed Explanations
Instant Access
Get Your Practice Test
36 comments · newest first
HE
Herschel
11 months ago
I didn't know Dataproc could handle all that!
JI
Jina
11 months ago
Wait, can we really just switch to Cloud Composer without issues?
MA
Marlon
11 months ago
D seems like the most straightforward option!
ED
Edda
11 months ago
I think B is better for large workloads, though.
AM
Amira
12 months ago
A sounds solid for migrating Hadoop to the cloud.
ON
Ona
12 months ago
I feel like option D is the best fit since it mentions both Dataproc and Cloud Composer, which we covered in a similar practice question.
LI
Lizette
1 year ago
I think using Cloud Composer for orchestration makes sense since it integrates well with other Google Cloud services. But I'm a bit confused about the differences between Composer and Airflow.
DE
Demetra
1 year ago
I'm not entirely sure about using Cloud Data Fusion for ETL. I thought we practiced more with Dataflow for those types of pipelines.
NO
Noemi
1 year ago
I remember we discussed Dataproc in class as a good option for migrating Hadoop clusters. It seems like a solid choice here.
MA
Makeda
1 year ago
Option C with Cloud Data Fusion looks promising. I like the idea of a visual pipeline designer to help modernize my ETL processes. That could save a lot of time and effort compared to manually converting everything.
AD
Adelina
1 year ago
I'm a bit unsure about this one. Option B with Bigtable and Cloud Composer sounds interesting, but I'm not sure how well it would integrate with my current Hadoop and Airflow setup. Might need to do some more research on that.
VE
Veronica
1 year ago
This seems like a straightforward migration to the cloud, so I'd go with option A. Dataproc and Dataflow should let me lift and shift my existing Hadoop and Airflow workloads with minimal changes.
CL
Clement
1 year ago
I'd probably go with option D. Dataproc and Cloud Composer seem like the safest bet to migrate my Hadoop and Airflow workloads to Google Cloud with minimal disruption. The integration should be pretty straightforward.
JE
Jerry
1 year ago
Okay, let me think this through. The question is asking about useful questions to ask during the design thinking process. I'll need to recall the main stages of that process and come up with appropriate questions for each.
LE
Lemuel
1 year ago
Okay, let's see. I think the key is to focus on the interfaces that the TAA needs to control and observe. Option C seems to capture that well.
GE
Geoffrey
1 year ago
Hmm, this looks like a tricky one. I'll need to think carefully about the different storage options that ACK supports.
LE
Lenora
1 year ago
I gotta say, these cloud services are really starting to sound like they were named by a team of engineers high on caffeine. 'Dataproc'? 'Cloud Composer'? I feel like I need a PhD in Google Cloud just to understand the question!
GE
Gerald
1 year ago
Wow, this is a tough one! I'm tempted to go with Option A just to keep things simple, but Option C seems like it offers the most comprehensive modernization. 'When in doubt, go with the most features!' - that's my motto!
CH
Chantell
1 year ago
Option B is an interesting approach, but I'm not sure Bigtable is the best fit for the large workloads mentioned in the question. I'd probably go with Option C for its more holistic solution.
CH
Cherelle
1 year ago
Yeah, using Dataproc to migrate Hadoop clusters and Cloud Data Fusion for ETL pipelines sounds like a solid plan.
JA
James
1 year ago
I agree, Option C seems to cover all the bases for modernizing the data strategy.
RE
Regenia
1 year ago
Option B is a good choice, but I think Option C offers a more comprehensive solution.
WI
Wilson
1 year ago
Yeah, Option C sounds like the best choice for migrating Hadoop clusters to Google Cloud and handling HDFS use cases.
TR
Tricia
1 year ago
I think Option C is the way to go as well, especially with the visual design and deployment of ETL pipelines using Cloud Data Fusion.
DO
Donte
1 year ago
I agree, Option C seems like a more comprehensive solution for handling the Hadoop workloads.
AN
Anisha
2 years ago
I'm leaning towards Option D. Using Dataproc and Cloud Composer seems like a straightforward approach that aligns well with the existing orchestration processes.
BA
Bambi
1 year ago
Yeah, it's important to minimize disruptions when updating your data strategy.
LI
Linn
1 year ago
Dataproc and Cloud Composer seem like a reliable combination for this migration.
EV
Evangelina
1 year ago
I agree, sticking with what you know can make the transition smoother.
AM
Amber
1 year ago
Option D sounds like a good choice. It keeps things simple and aligned with what you already have in place.
ED
Edward
2 years ago
Option C looks like the most comprehensive solution. Migrating Hadoop to Dataproc and using Cloud Storage for HDFS, while leveraging Cloud Data Fusion for visual ETL design, seems like a great way to modernize the architecture with minimal changes.
LE
Lenna
1 year ago
I agree, using Dataproc for migration, Cloud Storage for HDFS, and Cloud Data Fusion for ETL pipelines sounds like a solid plan.
LE
Leanora
1 year ago
Option C looks like the most comprehensive solution. Migrating Hadoop to Dataproc and using Cloud Storage for HDFS, while leveraging Cloud Data Fusion for visual ETL design, seems like a great way to modernize the architecture with minimal changes.
CO
Cordelia
2 years ago
We should also consider converting our ETL pipelines to Dataflow for better efficiency.
CO
Cory
2 years ago
I agree, and we can use Cloud Storage to handle any HDFS use cases.
CO
Cordelia
2 years ago
I think we should use Dataproc to migrate our Hadoop clusters to Google Cloud.