Databricks Certified Data Engineer Associate Exam - Topic 2 Question 44 Discussion

Actual exam question for Databricks's Databricks Certified Data Engineer Associate exam

Question #: 44
Topic #: 2

[All Databricks Certified Data Engineer Associate Questions]

Which query is performing a streaming hop from raw data to a Bronze table?

AOption A

BOption B

COption C

DOption D

Show Suggested Answer

Suggested Answer: D

The query performing a streaming hop from raw data to a Bronze table is identified by using the Spark streaming read capability and then writing to a Bronze table. Let's analyze the options:

Option A: Utilizes .writeStream but performs a complete aggregation which is more characteristic of a roll-up into a summarized table rather than a hop into a Bronze table.

Option B: Also uses .writeStream but calculates an average, which again does not typically represent the raw to Bronze transformation, which usually involves minimal transformations.

Option C: This uses a basic .write with .mode('append') which is not a streaming operation, and hence not suitable for real-time streaming data transformation to a Bronze table.

Option D: It employs spark.readStream.load() to ingest raw data as a stream and then writes it out with .writeStream, which is a typical pattern for streaming data into a Bronze table where raw data is captured in real-time and minimal transformation is applied. This approach aligns with the concept of a Bronze table in a modern data architecture, where raw data is ingested continuously and stored in a more accessible format.

Reference: Databricks documentation on Structured Streaming: Structured Streaming in Databricks

by Jamie at Jan 23, 2025, 02:38 AM

Limited Time Offer

25%

Off

Get Premium Databricks Certified Data Engineer Associate Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Hoa

4 months ago

Wait, are we sure this is about streaming hops?

upvoted 0 times

...

Buck

4 months ago

Definitely Option C, no doubt about it!

upvoted 0 times

...

Vi

4 months ago

Surprised that people are unsure about this!

upvoted 0 times

...

Jeannetta

4 months ago

I disagree, I believe it's Option A.

upvoted 0 times

...

Arlean

4 months ago

I think Option B is the right choice.

upvoted 0 times

...

Lili

5 months ago

I think Option A looks familiar, but I can't recall if it really represents the raw data transition to Bronze. I need to double-check my notes!

upvoted 0 times

...

Chauncey

5 months ago

I'm a bit confused about the differences between Bronze and Silver tables. I hope I can remember which query corresponds to the streaming process.

upvoted 0 times

...

Mendy

5 months ago

I remember practicing a similar question where we had to identify the correct data flow. I feel like Option C might be the right choice here.

upvoted 0 times

...

Jules

5 months ago

I think a streaming hop to a Bronze table should involve some sort of initial transformation, but I'm not entirely sure which option shows that clearly.

upvoted 0 times

...

Goldie

5 months ago

This is a tricky one, but I'm going to take my time and carefully examine each query. I want to make sure I understand the data movement before selecting my answer.

upvoted 0 times

...

Raylene

5 months ago

I'm feeling pretty confident about this one. Based on the data flow depicted in the images, Option A appears to be the only query performing a streaming hop from the raw data to the Bronze table.

upvoted 0 times

...

Gerri

5 months ago

Okay, I think I've got a handle on this. Option A looks like it's reading directly from the raw data source and writing to the Bronze table, so that's likely the streaming hop we're looking for.

upvoted 0 times

...

Dylan

5 months ago

Hmm, I'm a bit unsure about this one. The query syntax is not super familiar to me, so I'll need to really analyze the details of each option to figure out which one is doing the streaming hop.

upvoted 0 times

...

Edna

5 months ago

This looks like a pretty straightforward query comparison. I'll carefully review each option and think through the data flow to determine which one is performing a streaming hop to the Bronze table.

upvoted 0 times

...