Deal of The Day! Hurry Up, Grab the Special Discount - Save 25% - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions
Mail Us support@pass4success.com
Location US
Mob_nav_barsMENU

Databricks Certified Associate Developer for Apache Spark 3.5 Exam - Topic 6 Question 12 Discussion

A data scientist wants each record in the DataFrame to contain:The first attempt at the code does read the text files but each record contains a single line. This code is shown below:The entire contents of a fileThe full file pathThe issue: reading line-by-line rather than full text per file.Code:corpus = spark.read.text("/datasets/raw_txt/*") \.select('*', '_metadata.file_path')Which change will ensure one record per file?Options:
A) Add the option wholetext=True to the text() function
B) Add the option lineSep='\n' to the text() function
C) Add the option wholetext=False to the text() function
D) Add the option lineSep=', ' to the text() function

Databricks Certified Associate Developer for Apache Spark 3.5 Exam - Topic 6 Question 12 Discussion

Actual exam question for Databricks's Databricks Certified Associate Developer for Apache Spark 3.5 exam
Question #: 12
Topic #: 6
[All Databricks Certified Associate Developer for Apache Spark 3.5 Questions]

A data scientist wants each record in the DataFrame to contain:

The first attempt at the code does read the text files but each record contains a single line. This code is shown below:

The entire contents of a file

The full file path

The issue: reading line-by-line rather than full text per file.

Code:

corpus = spark.read.text("/datasets/raw_txt/*") \

.select('*', '_metadata.file_path')

Which change will ensure one record per file?

Options:

Show Suggested Answer Hide Answer
Suggested Answer: A

To read each file as a single record, use:

spark.read.text(path, wholetext=True)

This ensures that Spark reads the entire file contents into one row.


by Beula at Apr 01, 2026, 11:56 PM

Limited Time Offer

25%

Off

Get Premium Databricks Certified Associate Developer for Apache Spark 3.5 Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

0/2000 characters
Submit Cancel
Andra
1 month ago
Option B is tempting, but it won't solve the issue. We need whole text.
upvoted 0 times
...
Floyd
1 month ago
Agreed! We need one record per file, not line by line.
upvoted 0 times
...
Myrtie
1 month ago
I think option A is the best choice. Wholetext=True will read the entire file.
upvoted 0 times
...
Tashia
2 months ago
Not sure if A will work, seems too simple.
upvoted 0 times
...
Long
2 months ago
Wait, can you really read whole files like that?
upvoted 0 times
...
Lina
2 months ago
Definitely A, it makes the most sense.
upvoted 0 times
...
Lawrence
4 months ago
I think B is better for line separation.
upvoted 0 times
...
Dorethea
4 months ago
Option A is the way to go!
upvoted 0 times
...
Miesha
4 months ago
I’m confused about the options. I feel like `wholetext=True` makes sense, but I’m not 100% sure if it’s the only way to achieve that.
upvoted 0 times
...
Halina
5 months ago
This reminds me of a practice question where we had to adjust file reading options. I think `wholetext=False` would just keep it as is, right?
upvoted 0 times
...
Tequila
5 months ago
I'm not entirely sure, but I feel like the `lineSep` options are more about how to split lines rather than reading whole files.
upvoted 0 times
...
Roselle
5 months ago
I think I remember that the `wholetext=True` option is what we need to read the entire file as one record.
upvoted 0 times
...

Save Cancel