Free Preparation Discussions
MENU
Databricks Machine Learning Associate Exam - Topic 4 Question 14 Discussion
Topic #: 4
The implementation of linear regression in Spark ML first attempts to solve the linear regression problem using matrix decomposition, but this method does not scale well to large datasets with a large number of variables.
Which of the following approaches does Spark ML use to distribute the training of a linear regression model for large data?
For large datasets, Spark ML uses iterative optimization methods to distribute the training of a linear regression model. Specifically, Spark MLlib employs techniques like Stochastic Gradient Descent (SGD) and Limited-memory Broyden--Fletcher--Goldfarb--Shanno (L-BFGS) optimization to iteratively update the model parameters. These methods are well-suited for distributed computing environments because they can handle large-scale data efficiently by processing mini-batches of data and updating the model incrementally.
Databricks documentation on linear regression: Linear Regression in Spark ML
Bobbie
4 months agoEmmanuel
5 months agoJackie
5 months agoLashawn
5 months agoLili
5 months agoDevora
6 months agoFrank
6 months agoLucille
6 months agoElouise
6 months agoJeniffer
6 months agoShawana
6 months agoBrock
6 months agoFelicidad
6 months agoOmega
6 months agoMicaela
6 months agoSheridan
2 years agoCaprice
1 year agoDick
1 year agoYoulanda
1 year agoFranchesca
2 years agoFiliberto
1 year agoDesirae
2 years agoSusy
2 years agoTandra
2 years agoTiffiny
2 years agoFlorinda
2 years agoLilli
2 years agoEulah
2 years agoDaniela
2 years agoJeffrey
2 years agoAlisha
2 years ago