A data engineer needs to capture pipeline settings from an existing in the workspace, and use them to create and version a JSON file to create a new pipeline.
Which command should the data engineer enter in a web terminal configured with the Databricks CLI?
The Databricks CLI provides a way to automate interactions with Databricks services. When dealing with pipelines, you can use the databricks pipelines get --pipeline-id command to capture the settings of an existing pipeline in JSON format. This JSON can then be modified by removing the pipeline_id to prevent conflicts and renaming the pipeline to create a new pipeline. The modified JSON file can then be used with the databricks pipelines create command to create a new pipeline with those settings.
Databricks Documentation on CLI for Pipelines: Databricks CLI - Pipelines
Hershel
8 months agoLorrine
7 months agoTawanna
7 months agoWilda
8 months agoJesus
8 months agoRobt
8 months agoJenise
8 months agoDarrel
8 months agoKaitlyn
7 months agoTheodora
8 months agoStefania
8 months agoKayleigh
8 months agoMatilda
9 months agoMargot
9 months agoCarmela
9 months agoSean
7 months agoGladis
8 months agoThaddeus
8 months agoJosephine
9 months agoMarcos
9 months agoGalen
7 months agoCharisse
8 months agoElza
8 months agoJolanda
8 months agoMeghan
9 months agoLynette
9 months agoAlline
8 months agoReta
8 months agoLamar
9 months agoCoral
9 months ago