Mapping data flow comes with many transformation options. While working with data flows, you need to incorporate appropriate transformations to get the desired result. The Aggregate transformation helps to perform aggregations of data using Count, Min, Max, and Sum with expression builder in ADF. So let's begin with the implementation:- Implementation We are going to... Continue Reading →
Generally, Azure Data Factory aggregate transform has been used to perform COUNT, SUM, MIN, and MAX. The aggregate transform uses Azure Data Factory (ADF) expression to perform these computations. However, the aggregate transform can be used with a select transform to remove duplicate data. Let's see how we can achieve it. Data Source Just to... Continue Reading →
The schedule trigger runs automatically and invoke pipelines in an ADF. We can create multiple triggers to run a pipeline and create single trigger to run multiple pipeline. Let's suppose you have already implemented an ADF pipeline, if not you can find an example here to create an ADF pipeline so you need to create... Continue Reading →
Introduction: Azure Data Factory (ADF) supports Azure Key Vault linked service. This linked service connects your ADF pipeline to a Key Vault to fetch secrets. Overview of Data factory and Key Vault are covered in previous articles. Azure Key Vault using CLI Create Azure Data Factory Pipeline and perform copy activity This approach can be... Continue Reading →
This article talks how to create an Azure Data Factory from Azure Portal and perform a copy activity between. You need to create below services to implement a pipeline to perform copy activity. Create a resource group Create SQL Server Instance with one Database (Source Data) Create Storage Account with one Blob container Create Data... Continue Reading →
The Azure Data Factory is a data processing factory from multiple data sources. It is a cloud based ETL (Extract-transform-load) service and data integration service, helps to create data workflow between source and destination data source to establish data movement. The Azure Data Factory creates data work-flow between source data source and destination data source... Continue Reading →