In this article, we will discuss a number of questions about the Azure Data Factory service that you may be asked when applying to an Azure Data Engineer role.
Read more »
Ahmad Yaseen
Ahmad Yaseen is a Microsoft Big Data engineer with deep knowledge and experience in SQL BI, SQL Server Database Administration and Development fields.
He is a Microsoft Certified Solution Expert in Data Management and Analytics, Microsoft Certified Solution Associate in SQL Database Administration and Development, Azure Developer Associate and Microsoft Certified Trainer.
Also, he is contributing with his SQL tips in many blogs.
View all posts by Ahmad Yaseen
He is a Microsoft Certified Solution Expert in Data Management and Analytics, Microsoft Certified Solution Associate in SQL Database Administration and Development, Azure Developer Associate and Microsoft Certified Trainer.
Also, he is contributing with his SQL tips in many blogs.
View all posts by Ahmad Yaseen
Latest posts by Ahmad Yaseen (see all)
- Azure Data Factory Interview Questions and Answers - February 11, 2021
- How to monitor Azure Data Factory - January 15, 2021
- Using Source Control in Azure Data Factory - January 12, 2021
How to monitor Azure Data Factory
January 15, 2021In the previous articles of this series, we discussed how to perform different types of activities using Azure Data Factory. These tasks include copying data between different data stores, running SSIS packages and transforming data before writing it to a new data store.
Read more »
Using Source Control in Azure Data Factory
January 12, 2021In this article, we will show how to use the GIT repository during the pipeline development phase in Azure Data Factory, to save the changes incrementally before publishing it completely to the Data Factory production environment.
Read more »
Using Templates in Azure Data Factory
January 8, 2021In the previous articles of this Azure Data Factory series, we showed different scenarios in which we can take advantage of the Azure Data Factory in copying data from variant data stores and optionally transform the data before loading it to the destination datastore. In all examples that are provided in the previous articles, we created a new pipeline from scratch to achieve the required functionality.
Read more »
Dependencies in Azure Data Factory
December 30, 2020In the previous articles of this series, we showed how to create Azure Data Factory pipelines that consist of multiple activities to perform different actions, where the activities will be executed sequentially. This means that the next activity will not be executed until the previous activity is executed successfully without any issue.
Read more »
How to Debug a Pipeline in Azure Data Factory
December 30, 2020In the previous article, How to schedule Azure Data Factory pipeline executions using Triggers, we discussed the three main types of the Azure Data Factory triggers, how to configure it then use it to schedule a pipeline.
Read more »
How to schedule Azure Data Factory pipeline executions using Triggers
December 22, 2020In the previous articles, we discussed how to use the Azure Data Factory to move data between different data stores, how to transform data before writing it to a predefined sink, how to run an SSIS package using Azure Data Factory and how to use iterations and conditions activities in Azure Data Factory.
Read more »
How to use iterations and conditions activities in Azure Data Factory
December 17, 2020In the previous articles, we discussed how to create an Azure Data Factory pipeline to copy data between different data stores that are located in on-premises servers or in the cloud, how to transform data using Azure Data factory Mapping Dataflow activity and how to run an SSIS package using Azure Data Factory.
Read more »
Run SSIS packages in Azure Data Factory
November 9, 2020In the previous articles, we showed how to copy data between different data stores, located in an on-premises server or in the cloud and how to perform data transformation on that data using the Azure Data Factory.
Read more »
Transform data using a Mapping Data Flow in Azure Data Factory
November 4, 2020In the previous articles, Copy data between Azure data stores using Azure Data Factory and Copy data from On-premises data store to an Azure data store using Azure Data Factory, we saw how we can use the Azure Data Factory to copy data between different data stores located in an on-premises machine or in the cloud.
Read more »
Copy data from On-premises data store to an Azure data store using Azure Data Factory
October 29, 2020In the previous article, Copy data between Azure data stores using Azure Data Factory, we discussed how to copy the data stored in an Azure Blob Storage container to an Azure SQL Database table using Azure Data Factory and review the created pipeline components and result.
Read more »
Copy data between Azure data stores using Azure Data Factory
October 27, 2020In the previous article, Starting your journey with Microsoft Azure Data Factory, we discussed the main concept of the Azure Data Factory, described the Data Factory components and showed how to create a new Data Factory step by step.
Read more »
Starting your journey with Microsoft Azure Data Factory
October 21, 2020Working as an Azure Data Engineer, you are responsible for designing and implementing Azure data platform solutions in which you need to choose the best method to ingest structured, semi-structured and unstructured data that are generated from various data sources, in order to be processed in batches or in real-time by the applications and stored or visualized as per the project requirements.
Read more »
How to prepare for the Exam AZ-104: Microsoft Azure Administrator
September 28, 2020In this article, we will discuss how to prepare yourself for the Microsoft Azure Administrator certification exam.
Read more »
How to prepare for the Exam DP-201: Designing an Azure Data Solution
September 21, 2020In this article, we will discuss how to prepare yourself for an important Microsoft Azure exam: Designing an Azure Data Solution (DP-201).
Read more »
How to prepare for the Exam DP-200: Implementing an Azure Data Solution
September 16, 2020In this article, we will show how to prepare yourself for one of the important Microsoft Azure exams, DP-200: Implementing an Azure Data Solution certificate exam.
Read more »
How to prepare for the Exam DP-300: Administering Relational Databases on Microsoft Azure
September 14, 2020In this article, we will show how to prepare yourself for the DP-300 exam: Administering Relational Databases on the Microsoft Azure certificate exam.
Read more »
How to prepare for the Exam AZ-900: Microsoft Azure Fundamentals
September 9, 2020In this article, we will show how to prepare yourself for the Microsoft Azure Fundamentals exam (AZ-900).
Read more »
Data Engineer Interview Questions and Answers: SQL Workload Migration to Microsoft Azure Database Platforms
August 13, 2020In this article, we will discuss a number of questions that you may face when being interviewed to a Microsoft Azure Data Engineer position. These questions will focus on the process of migrating the SQL Server databases from the on-premises instances to the Microsoft Azure database services.
Read more »
Migrating SQL workloads to Microsoft Azure: Databases trip to Azure SQL Database Managed Instance
August 5, 2020In the previous two trips of this articles series, databases trip to SQL Server on Azure VM and to Azure SQL Database, we discussed the benefits of migrating your on-premises SQL Server databases to the Microsoft Azure database platforms and the methods that can be followed to migrate the on-premises databases to the Azure database platforms.
Read more »
Migrating SQL workloads to Microsoft Azure: Databases Trip to Azure SQL Database
August 3, 2020In the previous article of this series, Migrate SQL workloads to Microsoft Azure: Databases trip to SQL Server on Azure VM, we went through the methods that can be used for assessing your on-premises SQL Server databases before the migration process then migrating it to a SQL Server instance hosted in a Microsoft Azure VM.
Read more »
Migrating SQL workloads to Microsoft Azure: Databases Trip to SQL Server on Azure VM
July 31, 2020In the previous articles of this series, we built the bridge that leads us to the best way of migrating our SQL workload to Microsoft Azure, by showing how to create the databases migration strategy that contains a deep study of the current environment and the available options in Azure to replace the on-premises setup, which we tried to make it easier by providing all Azure database services and the workload that fits each service, and finally, we introduced several Microsoft tools and services that can be used to assess the current setup, provide migration guidance steps and migrate the databases to Microsoft Azure services with the minimal downtime.
Read more »
Migrating SQL workloads to Microsoft Azure: Assessment and Migration Tools
July 31, 2020In the previous articles of this series we discussed how to draw the initial strategy when planning to migrate the SQL workload to Microsoft Azure, the different database target platforms provided by Microsoft Azure that can be used as a migration target, based on the workload type, and finally, we went through some tools that help in discovering and assessing the on-premises environment by identifying the migration blocking issues and providing guidance steps for the migration process.
Read more »
Migrating SQL workloads to Microsoft Azure: Guidance and Assessment Tools
July 30, 2020In the previous articles, Migrating SQL workloads to Microsoft Azure: Planning the jump and Migrating SQL workloads to Microsoft Azure: Services Selection, we discussed the steps that you should follow when you start thinking loudly that you need to migrate your SQL workload to Azure, by checking your on-prem site and the available services and features in Azure that meet your workload handling requirements. After that, we went through different database services provided by Azure and which one fits a specific workload, in order to make it easy for you to translate the current workload as an Azure service.
Read more »
Migrating SQL workloads to Microsoft Azure: Services Selection
July 28, 2020In the previous article, Migrating SQL workloads to Microsoft Azure: Planning the jump, we discussed the main points that should be checked and considered while drawing your plan to migrate the SQL workload from the on-premises datacenters to Microsoft Azure. In this article, we will go through the different database services that are provided by Microsoft Azure to help you in selecting the proper service that can serve your SQL workload when migrating it to Microsoft Azure.
Read more »