Free Preparation Discussions
MENU
Databricks Certified Associate Developer for Apache Spark 3.5 Exam - Topic 2 Question 3 Discussion
Topic #: 2
2 of 55. Which command overwrites an existing JSON file when writing a DataFrame?
When writing DataFrames to files using the Spark DataFrameWriter API, Spark by default raises an error if the target path already exists. To explicitly overwrite existing data, you must specify the write mode as 'overwrite'.
Correct Syntax:
df.write.mode('overwrite').json('path/to/file')
This command removes the existing file or directory at the specified path and writes the new output in JSON format.
Other supported save modes include:
'append' --- Adds new data to existing files.
'ignore' --- Skips writing if the path already exists.
'error' or 'errorifexists' --- Fails the job if the output path exists (default).
Why other options are incorrect:
A: Defaults to 'error' mode, which fails if the path exists.
B: 'append' only adds data; it does not overwrite existing data.
C: .option('overwrite') is invalid --- mode('overwrite') must be used instead.
Reference (Databricks Apache Spark 3.5 -- Python / Study Guide):
PySpark API Reference: DataFrameWriter.mode() --- describes valid write modes including 'overwrite'.
PySpark API Reference: DataFrameWriter.json() --- method to write DataFrames in JSON format.
Databricks Certified Associate Developer for Apache Spark Exam Guide (June 2025): Section ''Using Spark DataFrame APIs'' --- Reading and writing DataFrames using save modes, schema management, and partitioning.
===========
Nell
1 day agoSunshine
6 days agoCasandra
12 days agoElenora
17 days agoJosue
22 days agoDomitila
27 days agoQueenie
2 months agoStevie
2 months agoTora
2 months agoBette
2 months agoLaurel
2 months agoEmiko
2 months agoBea
3 months agoShaniqua
3 months agoMiesha
3 months agoPok
3 months agoMollie
3 months agoTayna
3 months agoVerdell
4 months agoCarolynn
4 months agoCarmela
4 months agoShawana
4 months agoGaynell
5 months agoIola
5 months agoLashawnda
4 months ago