Free Preparation Discussions
MENU
Databricks Machine Learning Associate Exam - Topic 4 Question 14 Discussion
Topic #: 4
The implementation of linear regression in Spark ML first attempts to solve the linear regression problem using matrix decomposition, but this method does not scale well to large datasets with a large number of variables.
Which of the following approaches does Spark ML use to distribute the training of a linear regression model for large data?
For large datasets, Spark ML uses iterative optimization methods to distribute the training of a linear regression model. Specifically, Spark MLlib employs techniques like Stochastic Gradient Descent (SGD) and Limited-memory Broyden--Fletcher--Goldfarb--Shanno (L-BFGS) optimization to iteratively update the model parameters. These methods are well-suited for distributed computing environments because they can handle large-scale data efficiently by processing mini-batches of data and updating the model incrementally.
Databricks documentation on linear regression: Linear Regression in Spark ML
Bobbie
7 months agoEmmanuel
8 months agoJackie
8 months agoLashawn
8 months agoLili
8 months agoDevora
9 months agoFrank
9 months agoLucille
9 months agoElouise
9 months agoJeniffer
9 months agoShawana
9 months agoBrock
9 months agoFelicidad
9 months agoOmega
9 months agoMicaela
9 months agoSheridan
2 years agoCaprice
2 years agoDick
2 years agoYoulanda
2 years agoFranchesca
2 years agoFiliberto
2 years agoDesirae
2 years agoSusy
2 years agoTandra
2 years agoTiffiny
2 years agoFlorinda
2 years agoLilli
2 years agoEulah
2 years agoDaniela
2 years agoJeffrey
2 years agoAlisha
2 years ago