Google Exam Professional Data Engineer Topic 3 Question 48 Discussion

Actual exam question for Google's Professional Data Engineer exam

Question #: 48
Topic #: 3

[All Professional Data Engineer Questions]

You have historical data covering the last three years in BigQuery and a data pipeline that delivers new data to BigQuery daily. You have noticed that when the Data Science team runs a query filtered on a date column and limited to 30--90 days of data, the query scans the entire table. You also noticed that your bill is increasing more quickly than you expected. You want to resolve the issue as cost-effectively as possible while maintaining the ability to conduct SQL queries. What should you do?

ARe-create the tables using DDL. Partition the tables by a column containing a TIMESTAMP or DATE Type.

BRecommend that the Data Science team export the table to a CSV file on Cloud Storage and use Cloud Datalab to explore the data by reading the files directly.

CModify your pipeline to maintain the last 30--90 days of data in one table and the longer history in a different table to minimize full table scans over the entire history.

DWrite an Apache Beam pipeline that creates a BigQuery table per day. Recommend that the Data Science team use wildcards on the table name suffixes to select the data they need.

Show Suggested Answer

Suggested Answer: C

by Andra at May 08, 2022, 04:16 PM

Limited Time Offer

25%

Off

Get Premium Professional Data Engineer Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Laurena

5 days ago

I think partitioning the tables by date could really help with the query performance, but I'm not entirely sure if that's the only solution we need.

upvoted 0 times

...

King

10 days ago

I'm a bit unsure about this. Does a macro really cover both requirements of automating tasks and sharing knowledge articles? I'll need to think this through more carefully.

upvoted 0 times

...

Jose

18 days ago

I'm a bit confused by this question. I'll need to re-read it and think through what information is required to properly set up the invoice discount terms for the vendor in Sweden.

upvoted 0 times

...