Deal of The Day! Hurry Up, Grab the Special Discount - Save 25% - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions

Databricks Certified Data Engineer Associate Exam - Topic 2 Question 66 Discussion

A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL.Which of the following commands could the data engineering team use to access sales in PySpark?
E) spark.table('sales')
A) SELECT * FROM sales
B) There is no way to share data between PySpark and SQL.
C) spark.sql('sales')
D) spark.delta.table('sales')

Databricks Certified Data Engineer Associate Exam - Topic 2 Question 66 Discussion

Actual exam question for Databricks's Databricks Certified Data Engineer Associate exam
Question #: 66
Topic #: 2
[All Databricks Certified Data Engineer Associate Questions]

A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL.

Which of the following commands could the data engineering team use to access sales in PySpark?

Show Suggested Answer Hide Answer
Suggested Answer: E

The data engineering team can use thespark.tablemethod to access the Delta tablesalesin PySpark. This method returns a DataFrame representation of the Delta table, which can be used for further processing or testing.Thespark.tablemethod works for any table that is registered in the Hive metastore or the Spark catalog, regardless of the file format1.Alternatively, the data engineering team can also use theDeltaTable.forPathmethod to load the Delta table from its path2.Reference:1:SparkSession | PySpark 3.2.0 documentation2:Welcome to Delta Lake's Python documentation page --- delta-spark 2.4.0 documentation


Contribute your Thoughts:

0/2000 characters

Currently there are no comments in this discussion, be the first to comment!


Save Cancel