Databricks Certified Associate Developer for Apache Spark 3.5 Exam - Topic 6 Question 12 Discussion

Actual exam question for Databricks's Databricks Certified Associate Developer for Apache Spark 3.5 exam

Question #: 12
Topic #: 6

A data scientist wants each record in the DataFrame to contain:

The first attempt at the code does read the text files but each record contains a single line. This code is shown below:

The entire contents of a file

The full file path

The issue: reading line-by-line rather than full text per file.

Code:

corpus = spark.read.text("/datasets/raw_txt/*") \

.select('*', '_metadata.file_path')

Which change will ensure one record per file?

Options:

AAdd the option wholetext=True to the text() function

BAdd the option lineSep='\n' to the text() function

CAdd the option wholetext=False to the text() function

DAdd the option lineSep=', ' to the text() function

Show Suggested Answer

Suggested Answer: A

To read each file as a single record, use:

spark.read.text(path, wholetext=True)

This ensures that Spark reads the entire file contents into one row.

by Beula at Apr 01, 2026, 11:56 PM

Limited Time Offer

25%

2 months ago

I think I remember that the `wholetext=True` option is what we need to read the entire file as one record.

upvoted 0 times

...