Databricks Certified Data Engineer Associate Exam - Topic 1 Question 2 Discussion

Actual exam question for Databricks's Databricks Certified Data Engineer Associate exam

Question #: 2
Topic #: 1

[All Databricks Certified Data Engineer Associate Questions]

In order for Structured Streaming to reliably track the exact progress of the processing so that it can handle any kind of failure by restarting and/or reprocessing, which of the following two approaches is used by Spark to record the offset range of the data being processed in each trigger?

ACheckpointing and Write-ahead Logs

BStructured Streaming cannot record the offset range of the data being processed in each trigger.

CReplayable Sources and Idempotent Sinks

DWrite-ahead Logs and Idempotent Sinks

ECheckpointing and Idempotent Sinks

Show Suggested Answer

Suggested Answer: E

by Cristal at Apr 03, 2023, 08:37 AM

Limited Time Offer

25%

Off

Get Premium Databricks Certified Data Engineer Associate Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Edelmira

5 months ago

I didn’t know about Write-ahead Logs before, that’s cool!

upvoted 0 times

...

Zita

5 months ago

A seems correct, but D is interesting too.

upvoted 0 times

...

Katina

6 months ago

Wait, are you sure? I thought it was C.

upvoted 0 times

...

Rodolfo

6 months ago

I agree, A is the right choice!

upvoted 0 times

...

Joye

6 months ago

It's definitely A - Checkpointing and Write-ahead Logs!

upvoted 0 times

...

Judy

6 months ago

I feel like replayable sources were mentioned in our notes, but I can't recall if they were part of the answer options we practiced.

upvoted 0 times

...

Marti

6 months ago

I'm a bit confused about the role of idempotent sinks here. Do they really help with tracking offsets?

upvoted 0 times

...

Ivory

6 months ago

I think the answer might be A, since we practiced a similar question about fault tolerance in Structured Streaming.

upvoted 0 times

...

Quinn

6 months ago

I remember we discussed checkpointing in class, but I'm not entirely sure how it relates to write-ahead logs.

upvoted 0 times

...

Nydia

6 months ago

Option C about enabling termination protection doesn't seem relevant here. We want to delete the stack, just not the DynamoDB table. I'm leaning towards A or D as the best approaches.

upvoted 0 times

...

Avery

6 months ago

This seems like a straightforward question about the benefits of mentoring. I'll focus on understanding the key aspects of mentoring and how they relate to the answer choices.

upvoted 0 times

...