Free Preparation Discussions
MENU
Databricks Machine Learning Associate Exam - Topic 4 Question 14 Discussion
Topic #: 4
The implementation of linear regression in Spark ML first attempts to solve the linear regression problem using matrix decomposition, but this method does not scale well to large datasets with a large number of variables.
Which of the following approaches does Spark ML use to distribute the training of a linear regression model for large data?
For large datasets, Spark ML uses iterative optimization methods to distribute the training of a linear regression model. Specifically, Spark MLlib employs techniques like Stochastic Gradient Descent (SGD) and Limited-memory Broyden--Fletcher--Goldfarb--Shanno (L-BFGS) optimization to iteratively update the model parameters. These methods are well-suited for distributed computing environments because they can handle large-scale data efficiently by processing mini-batches of data and updating the model incrementally.
Databricks documentation on linear regression: Linear Regression in Spark ML
Bobbie
6 months agoEmmanuel
6 months agoJackie
6 months agoLashawn
7 months agoLili
7 months agoDevora
7 months agoFrank
7 months agoLucille
7 months agoElouise
8 months agoJeniffer
8 months agoShawana
8 months agoBrock
8 months agoFelicidad
8 months agoOmega
8 months agoMicaela
8 months agoSheridan
2 years agoCaprice
2 years agoDick
2 years agoYoulanda
2 years agoFranchesca
2 years agoFiliberto
2 years agoDesirae
2 years agoSusy
2 years agoTandra
2 years agoTiffiny
2 years agoFlorinda
2 years agoLilli
2 years agoEulah
2 years agoDaniela
2 years agoJeffrey
2 years agoAlisha
2 years ago