Note: This question is part of a series of questions that present the same scenario. Each question in the series contains a unique solution that might meet the stated goals. Some question sets might have more than one correct solution, while others might not have a correct solution.
After you answer a question in this section, you will NOT be able to return to it. As a result, these questions will not appear in the review screen.
You have an Azure Data Lake Storage account that contains a staging zone.
You need to design a daily process to ingest incremental data from the staging zone, transform the data by executing an R script, and then insert the transformed data into a data warehouse in Azure Synapse Analytics.
Solution: You use an Azure Data Factory schedule trigger to execute a pipeline that executes mapping data flow, and then inserts the data into the data warehouse.
Does this meet the goal?
If you need to transform data in a way that is not supported by Data Factory, you can create a custom activity,
not a mapping flow,5 with your own data processing logic and use the activity in the pipeline. You can create a
custom activity to run R scripts on your HDInsight cluster with R installed.
https://docs.microsoft.com/en-US/azure/data-factory/transform-data
Patti
10 months agoIsidra
10 months agoLeoma
11 months agoPrincess
11 months agoOra
11 months agoHyman
11 months agoBeth
11 months agoBilly
11 months agoTien
11 months agoFabiola
11 months agoDulce
11 months agoKayleigh
11 months ago