Free Preparation Discussions
MENU
Google Professional Data Engineer Exam - Topic 2 Question 93 Discussion
Topic #: 2
When creating a new Cloud Dataproc cluster with the projects.regions.clusters.create operation, these four values are required: project, region, name, and ____.
To improve the performance of querying a large BigQuery table with filters on countryname and username, clustering the table by these fields is the most effective approach. Here's why option C is the best choice:
Clustering in BigQuery:
Clustering organizes data based on the values in specified columns. This can significantly improve query performance by reducing the amount of data scanned during query execution.
Clustering by countryname and username means that data is physically sorted and stored together based on these fields, allowing BigQuery to quickly locate and read only the relevant data for queries using these filters.
Filter Efficiency:
With the table clustered by countryname and username, queries that filter on these columns can benefit from efficient data retrieval, reducing the amount of data processed and speeding up query execution.
This directly addresses the performance issue of the dashboard queries that apply filters on these fields.
Steps to Implement:
Redesign the Table:
Create a new table with clustering on countryname and username:
CREATE TABLE project.dataset.new_table
CLUSTER BY countryname, username AS
SELECT * FROM project.dataset.customer_order;
Migrate Data:
Transfer the existing data from the original table to the new clustered table.
Update Queries:
Modify the dashboard queries to reference the new clustered table.
BigQuery Clustering Documentation
Optimizing Query Performance
Virgie
3 months agoJoye
3 months agoDolores
3 months agoChrista
4 months agoJennie
4 months agoFiliberto
4 months agoZona
4 months agoAnnamae
4 months agoCharlie
5 months agoArlean
5 months agoLeah
5 months agoEden
5 months agoWendell
5 months agoVeta
5 months agoPolly
9 months agoNobuko
8 months agoJennie
8 months agoCassie
8 months agoTiera
8 months agoBettina
9 months agoSimona
9 months agoDyan
9 months agoDomonique
10 months agoErnest
8 months agoTasia
9 months agoDenny
9 months agoSusana
10 months agoLavonne
9 months agoCyril
9 months agoMila
9 months agoMakeda
10 months agoAleta
9 months agoEric
10 months agoEstrella
10 months agoHerschel
10 months agoClorinda
10 months agoGabriele
9 months agoHoward
10 months agoLouis
11 months agoDexter
11 months agoEric
11 months ago