Deal of The Day! Hurry Up, Grab the Special Discount - Save 25% - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions

Google Professional Data Engineer Exam - Topic 4 Question 123 Discussion

You are designing a data processing pipeline. The pipeline must be able to scale automatically as load increases. Messages must be processed at least once, and must be ordered within windows of 1 hour. How should you design the solution?
D) Use Cloud Pub/Sub for message ingestion and Cloud Dataflow for streaming analysis.
A) Use Apache Kafka for message ingestion and use Cloud Dataproc for streaming analysis.
B) Use Apache Kafka for message ingestion and use Cloud Dataflow for streaming analysis.
C) Use Cloud Pub/Sub for message ingestion and Cloud Dataproc for streaming analysis.

Google Professional Data Engineer Exam - Topic 4 Question 123 Discussion

Actual exam question for Google's Professional Data Engineer exam
Question #: 123
Topic #: 4
[All Professional Data Engineer Questions]

You are designing a data processing pipeline. The pipeline must be able to scale automatically as load increases. Messages must be processed at least once, and must be ordered within windows of 1 hour. How should you design the solution?

Show Suggested Answer Hide Answer
Suggested Answer: D

Contribute your Thoughts:

0/2000 characters
Youlanda
2 days ago
I feel like we practiced a similar question where we had to choose between Pub/Sub and Kafka, but I can't recall the exact advantages of each.
upvoted 0 times
...
Mauricio
7 days ago
I think Cloud Dataflow is designed for stream processing and can scale automatically, which might make option B or D the best choices.
upvoted 0 times
...
Karon
12 days ago
I remember we discussed Kafka and its ability to handle high throughput, but I'm not sure if it guarantees message ordering within the specified windows.
upvoted 0 times
...

Save Cancel