MENU
In order for Structured Streaming to reliably track the exact progress of the processing so that it can handle any kind of failure by restarting and/or reprocessing, which of the following two approaches is used by Spark to record the offset range of the data being processed in each trigger?
Suggested Answer: E
Get Premium Databricks Certified Data Engineer Associate Questions
as Interactive Web-Based Practice Test or PDF
Real Exam Format
Detailed Explanations
Instant Access
Get Your Practice Test
11 comments · newest first
ED
Edelmira
11 months ago
I didn’t know about Write-ahead Logs before, that’s cool!
ZI
Zita
11 months ago
A seems correct, but D is interesting too.
KA
Katina
12 months ago
Wait, are you sure? I thought it was C.
RO
Rodolfo
12 months ago
I agree, A is the right choice!
JO
Joye
12 months ago
It's definitely A - Checkpointing and Write-ahead Logs!
JU
Judy
1 year ago
I feel like replayable sources were mentioned in our notes, but I can't recall if they were part of the answer options we practiced.
MA
Marti
1 year ago
I'm a bit confused about the role of idempotent sinks here. Do they really help with tracking offsets?
IV
Ivory
1 year ago
I think the answer might be A, since we practiced a similar question about fault tolerance in Structured Streaming.
QU
Quinn
1 year ago
I remember we discussed checkpointing in class, but I'm not entirely sure how it relates to write-ahead logs.
NY
Nydia
1 year ago
Option C about enabling termination protection doesn't seem relevant here. We want to delete the stack, just not the DynamoDB table. I'm leaning towards A or D as the best approaches.
AV
Avery
1 year ago
This seems like a straightforward question about the benefits of mentoring. I'll focus on understanding the key aspects of mentoring and how they relate to the answer choices.