Deal of The Day! Hurry Up, Grab the Special Discount - Save 25% - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions

Databricks Certified Data Engineer Professional Exam - Topic 5 Question 49 Discussion

The data engineering team is migrating an enterprise system with thousands of tables and views into the Lakehouse. They plan to implement the target architecture using a series of bronze, silver, and gold tables. Bronze tables will almost exclusively be used by production data engineering workloads, while silver tables will be used to support both data engineering and machine learning workloads. Gold tables will largely serve business intelligence and reporting purposes. While personal identifying information (PII) exists in all tiers of data, pseudonymization and anonymization rules are in place for all data at the silver and gold levels.The organization is interested in reducing security concerns while maximizing the ability to collaborate across diverse teams.Which statement exemplifies best practices for implementing this system?
A) Isolating tables in separate databases based on data quality tiers allows for easy permissions management through database ACLs and allows physical separation of default storage locations for managed tables.
B) Because databases on Databricks are merely a logical construct, choices around database organization do not impact security or discoverability in the Lakehouse.
C) Storinq all production tables in a single database provides a unified view of all data assets available throughout the Lakehouse, simplifying discoverability by granting all users view privileges on this database.
D) Working in the default Databricks database provides the greatest security when working with managed tables, as these will be created in the DBFS root.
E) Because all tables must live in the same storage containers used for the database they're created in, organizations should be prepared to create between dozens and thousands of databases depending on their data isolation requirements.

Databricks Certified Data Engineer Professional Exam - Topic 5 Question 49 Discussion

Actual exam question for Databricks's Databricks Certified Data Engineer Professional exam
Question #: 49
Topic #: 5
[All Databricks Certified Data Engineer Professional Questions]

The data engineering team is migrating an enterprise system with thousands of tables and views into the Lakehouse. They plan to implement the target architecture using a series of bronze, silver, and gold tables. Bronze tables will almost exclusively be used by production data engineering workloads, while silver tables will be used to support both data engineering and machine learning workloads. Gold tables will largely serve business intelligence and reporting purposes. While personal identifying information (PII) exists in all tiers of data, pseudonymization and anonymization rules are in place for all data at the silver and gold levels.

The organization is interested in reducing security concerns while maximizing the ability to collaborate across diverse teams.

Which statement exemplifies best practices for implementing this system?

Show Suggested Answer Hide Answer
Suggested Answer: A

This is the correct answer because it exemplifies best practices for implementing this system. By isolating tables in separate databases based on data quality tiers, such as bronze, silver, and gold, the data engineering team can achieve several benefits. First, they can easily manage permissions for different users and groups through database ACLs, which allow granting or revoking access to databases, tables, or views. Second, they can physically separate the default storage locations for managed tables in each database, which can improve performance and reduce costs. Third, they can provide a clear and consistent naming convention for the tables in each database, which can improve discoverability and usability. Verified Reference: [Databricks Certified Data Engineer Professional], under ''Lakehouse'' section; Databricks Documentation, under ''Database object privileges'' section.


Contribute your Thoughts:

0/2000 characters
Leonardo
1 day ago
A) makes sense for permissions management!
upvoted 0 times
...
Ellsworth
6 days ago
C is a bad idea, too much access can lead to issues.
upvoted 0 times
...
Noe
11 days ago
Surprised by E, that sounds like a lot of databases!
upvoted 0 times
...
Lawrence
17 days ago
B seems off, database organization definitely impacts security.
upvoted 0 times
...
Beata
22 days ago
Totally agree with A, isolation is key.
upvoted 0 times
...
Luke
27 days ago
A) makes sense for permissions management!
upvoted 0 times
...
Gracia
1 month ago
I recall that having all production tables in one database could simplify discoverability, but I wonder if that compromises security in any way.
upvoted 0 times
...
Royal
1 month ago
I’m a bit confused about the impact of database organization on security. I thought it was just a logical construct, but maybe it does matter more than I thought?
upvoted 0 times
...
Marylyn
1 month ago
I think we practiced a question similar to this where we talked about permissions management. Isolating tables might really help with that.
upvoted 0 times
...
Desmond
3 months ago
I remember discussing the importance of isolating data based on quality tiers, but I'm not entirely sure if that means separate databases are always necessary.
upvoted 0 times
...

Save Cancel