Free Preparation Discussions
MENU
Databricks Exam Databricks-Machine-Learning-Associate Topic 3 Question 26 Discussion
Topic #: 3
A data scientist wants to use Spark ML to one-hot encode the categorical features in their PySpark DataFrame features_df. A list of the names of the string columns is assigned to the input_columns variable.
They have developed this code block to accomplish this task:
The code block is returning an error.
Which of the following adjustments does the data scientist need to make to accomplish this task?
For large datasets, Spark ML uses iterative optimization methods to distribute the training of a linear regression model. Specifically, Spark MLlib employs techniques like Stochastic Gradient Descent (SGD) and Limited-memory Broyden--Fletcher--Goldfarb--Shanno (L-BFGS) optimization to iteratively update the model parameters. These methods are well-suited for distributed computing environments because they can handle large-scale data efficiently by processing mini-batches of data and updating the model incrementally.
Databricks documentation on linear regression: Linear Regression in Spark ML
Thurman
7 days agoShannan
11 days agoAlfred
21 days agoRosendo
28 days agoJoaquin
9 days agoEden
17 days agoJenelle
1 months agoReita
17 days agoLigia
1 months agoQuentin
1 months agoLawrence
14 days agoAdaline
23 days agoEssie
1 months agoDaisy
2 months ago