In this article, I am going to explain how to create a serverless application using Azure Functions and use Azure SQL Database to log messages generated by the function. In this world of cloud-based applications, it is very important that you are aware of how to create and design serverless applications. An important aspect while designing any application is to generate log messages at every key step or operation that is being performed. This helps us to understand the workflow whenever there are some issues and need debugging at some later point in time.
Read more »Build a Google BigQuery report with Google Data Studio
December 25, 2020Introduction
In the two-part SQL Shack article, Build a Google BigQuery Resource, I showed how to build a Google BigQuery resource, and then link it to an Azure SQL Server resource. This article will expand on that first part, showing how to build a BigQuery report with Google Data Studio.
Read more »Import data from MongoDB to SQL Server using SSIS
December 25, 2020In this article, we will explain how to install MongoDB on the Windows operating system, how to install and configure the ODBC driver and connector that allows us to import data from MongoDB to SQL Server using SSIS.
Read more »Introduction to the Power BI Service
December 24, 2020Microsoft Power BI is a data analytics tool available in two flavors: Power BI Desktop and a Power BI Service.
Read more »T-SQL scripts to update statistics based on the row modification
December 24, 2020In this article, we are going to learn how we can develop a T-SQL script to update statistics of tables based on the row modification. It is always a challenging task to perform maintenance on a table that has billions of rows. During the early years of my professional career, I was assigned a project and one of our clients had performance issues. The initial analysis showed that due to frequent data modifications, a specific table’s statistics become outdated.
Read more »Rewind or Forward the Amazon Aurora Cluster with MySQL compatibility using backtrack feature
December 24, 2020In this article, we will explore the useful backtrack feature for Amazon Aurora clusters.
Read more »Creating your first Azure SQL Database
December 23, 2020Introduction
You might be thinking why do you want to create Azure SQL Database and what are the best configurations. This article will provide you with the basic configurations of the Azure SQL Database.
Read more »Building U-SQL jobs locally for Azure Data Lake Analytics
December 23, 2020This article will help you learn to develop U-SQL jobs locally, which once ready, can be deployed on Azure Data Lake Analytics service on the Azure cloud.
Read more »Deploying U-SQL jobs on Azure Data Lake Analytics
December 23, 2020In this article, we will learn how to execute U-SQL jobs that have been developed or tested locally, to the production environment from a local machine.
Read more »Different ways to login to Azure automation using PowerShell
December 22, 2020PowerShell becomes a de facto toolset in the arsenal of Azure automation. PowerShell provides a platform and a friendly way of automating many repeated tasks, which in turn minimize the time-and-cost. PowerShell always comes to the rescue when there is a need for automation, and it is no different for Azure. If you are already familiar with PowerShell cmdlets, then it will be easy to be acquainted with Azure PowerShell modules. For Azure automation, Microsoft provided a set of Azure PowerShell Modules that can be leverage to manage the Azure Cloud platform.
Read more »How to schedule Azure Data Factory pipeline executions using Triggers
December 22, 2020In the previous articles, we discussed how to use the Azure Data Factory to move data between different data stores, how to transform data before writing it to a predefined sink, how to run an SSIS package using Azure Data Factory and how to use iterations and conditions activities in Azure Data Factory.
Read more »How to track data changes on Azure SQL Database
December 21, 2020In this article, we will guide you through tracking data changes on the Azure SQL database and introduce common use case scenarios and learn how to get the most out of system-versioned tables.
Read more »Explore Amazon Aurora global databases with MySQL compatibility
December 21, 2020In the article, Deploy your AWS RDS Aurora database clusters for MySQL, we explored the Amazon Aurora concept and deployment. In this article, we will understand about the global database feature and its implementations.
Read more »Developing U-SQL jobs on Azure Data Lake Analytics
December 21, 2020In this article, we will learn how to develop U-SQL jobs on Azure Data Lake Analytics to process data stored in Data Lake Storage.
Read more »Deploy your Amazon Aurora database clusters for MySQL
December 18, 2020Introduction
Amazon offers managed database service for various database products such as Microsoft SQL Server, MySQL, PostgreSQL, Oracle. In these relational database services (RDS), AWS manages the operating system, networking components, backups, monitoring solutions. In the previous articles, we explored many useful RDS features under the AWS RDS category on SQLShack.
Read more »How to use iterations and conditions activities in Azure Data Factory
December 17, 2020In the previous articles, we discussed how to create an Azure Data Factory pipeline to copy data between different data stores that are located in on-premises servers or in the cloud, how to transform data using Azure Data factory Mapping Dataflow activity and how to run an SSIS package using Azure Data Factory.
Read more »Getting started with Azure Data Lake Analytics
December 15, 2020This article aims to help you understand the concept of Azure Data Lake Analytics capability offered by Microsoft in the Azure cloud.
Read more »Introduction to the SQL Server Agent
December 15, 2020In this article, I am going to explain in detail about the SQL Server Agent service. This is a windows service that enables database developers and database administrators to schedule jobs on the SQL Server machine. The jobs can be simple T-SQL scripts, stored procedures, SSIS packages or SSAS databases. This service is available on all the editions of SQL Server except the Express edition.
Read more »Web Scraping for SQL Machine learning using R scripts
December 14, 2020In this article, we will explore Web Scraping using R Scripts for SQL Machine Learning.
Read more »Configure Integration Services Catalog Database SSISDB in SQL Server Always On Availability Groups
December 14, 2020In this 39th article for SQL Server Always On Availability Group series, we will learn to configure SSISDB in the highly available AG groups.
Read more »Configure SQL Server Always On Availability Groups using Windows PowerShell scripts
December 10, 2020In this 38th article for SQL Server Always On Availability Groups, we will explore Windows PowerShell scripts to configure it.
Read more »Explore the secrets of SQL Server execution plans
December 10, 2020The SQL Server execution plan (query plan) is a set of instructions that describes which process steps are performed while a query is executed by the database engine. The query plans are generated by the query optimizer and its essential goal is to generate the most efficient (optimum) and economical query plan. Some query plans that are created by the query optimizer contain some interesting characteristics. In this article, we will go into details of these interesting query plans.
Read more »How to install SQL Server 2019 on RedHat Linux 18
December 9, 2020In this article, we will learn to install SQL Server 2019 on the RedHat Linux 18 on a virtual machine.
Read more »Understanding Change Tracking in SQL Server using Triggers
December 9, 2020In this article, I am going to explain what change tracking is in SQL Server and why do we need it. I will also illustrate the same using some practical examples using triggers in SQL Server. Change tracking as the name suggests, is a mechanism that helps us to identify the changes in the database as the application grows. In other words, it enables us to have a history of the changes that have been made to one or more tables in the database. The changes can be considered as either INSERTs, UPDATEs, or DELETEs.
Read more »A case study of SQL Query tuning in SQL Server
December 8, 2020Gaining experience in SQL query tuning can be very difficult and complicated for database developers or administrators. For this reason, in this article, we will work on a case study and we are going to learn how we can tune its performance step by step. In this fashion, we will understand well how to approach query performance issues practically.
Read more »