A data engineer is writing a script that is meant to ingest new data from cloud storage. In the event of the Schema change, the ingestion should fail. It should fail until the changes downstream source can be found and verified as intended changes.
Which command will meet the requirements?
Suggested Answer: B
Get Premium Databricks Certified Data Engineer Associate Questions
as Interactive Web-Based Practice Test or PDF
Real Exam Format
Detailed Explanations
Instant Access
Get Your Practice Test
12 comments · newest first
OD
Odette
1 month ago
But what about A? It could add new columns without failing.
TH
Thurman
1 month ago
I agree, B makes sense. We need to ensure data integrity.
LI
Linsey
1 month ago
I think B is the best choice. It clearly indicates failure on new columns.
TH
Thurman
2 months ago
Seems a bit strict to fail on schema changes, right?
OL
Oliva
2 months ago
I thought D) none could work too, but I guess not.
LY
Lyndia
2 months ago
Wait, are we sure it won't just skip the new columns?
DE
Deandrea
2 months ago
I agree, that makes the most sense.
JE
Jerry
2 months ago
B) failOnNewColumns is the right choice!
BE
Beula
3 months ago
I’m leaning towards "failOnNewColumns" too, but I wonder if "none" could be a trick option since it implies no action is taken.
AN
Antonette
3 months ago
I’m a bit confused; I feel like "addNewColumns" might also be relevant, but it doesn’t seem to align with the requirement to fail.
LO
Louann
3 months ago
I remember practicing a similar question where we had to handle schema changes, and I think "failOnNewColumns" sounds right for this scenario.
BR
Brent
3 months ago
I think the command should be something that explicitly fails on schema changes, but I’m not entirely sure which one it is.