Google Professional Data Engineer Exam - Topic 1 Question 38 Discussion

Actual exam question for Google's Professional Data Engineer exam

Question #: 38
Topic #: 1

[All Professional Data Engineer Questions]

You are building a report-only data warehouse where the data is streamed into BigQuery via the streaming API Following Google's best practices, you have both a staging and a production table for the data How should you design your data loading to ensure that there is only one master dataset without affecting performance on either the ingestion or reporting pieces?

AHave a staging table that is an append-only model, and then update the production table every three hours
with the changes written to staging

BHave a staging table that is an append-only model, and then update the production table every ninety
minutes with the changes written to staging

CHave a staging table that moves the staged data over to the production table and deletes the contents of the
staging table every three hours

DHave a staging table that moves the staged data over to the production table and deletes the contents of the staging table every thirty minutes

Show Suggested Answer

Suggested Answer: D

by Mireya at May 10, 2022, 01:38 AM

Limited Time Offer

25%

Off

Get Premium Professional Data Engineer Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Charlena

4 months ago

Not sure if updating every three hours is fast enough for real-time needs.

upvoted 0 times

...

Rolf

4 months ago

I like the idea of keeping it append-only in staging, so A or B are good.

upvoted 0 times

...

Frankie

4 months ago

Surprised that no one mentioned the potential data loss with option C!

upvoted 0 times

...

Kate

4 months ago

I disagree, option D seems more efficient with the 30-minute updates.

upvoted 0 times

...

Dorothy

5 months ago

I think option B makes the most sense for performance.

upvoted 0 times

...

Andree

5 months ago

I recall that frequent updates can help maintain performance, but I wonder if thirty minutes is too aggressive. It seems like it could lead to more overhead.

upvoted 0 times

...

Elouise

5 months ago

I’m a bit confused about whether moving data to production and deleting the staging contents is the best approach. I thought we should keep staging intact for a while.

upvoted 0 times

...

Rima

5 months ago

I think we practiced a similar question where the frequency of updates was crucial. I feel like every ninety minutes might strike a good balance for performance.

upvoted 0 times

...

Ryan

5 months ago

I remember we discussed the importance of keeping the staging table append-only to avoid data loss, but I'm not sure about the timing for updating the production table.

upvoted 0 times

...

Andra

5 months ago

This is a tricky one. I'll need to think carefully about the cloud native trailmap and what it covers.

upvoted 0 times

...

Micaela

5 months ago

This seems straightforward - we need to give external researchers and internal staff access to collaborate, so I think creating a portal for the external researchers and giving the internal staff access to the main org is the way to go.

upvoted 0 times

...

Tijuana

5 months ago

I'm pretty sure it's a prefix of Splunk_TA_, but I'll double-check the Splunk documentation to be sure.

upvoted 0 times

...

Marilynn

5 months ago

I remember a practice question that focused on the authority of the officer. Is that required too?

upvoted 0 times

...