In this article, I am going to explain in detail the Pandas Dataframe objects in python. In the previous article in this series Learn Pandas in Python, I have explained what pandas are and how can we install the same in our development machines. I have also explained the use of pandas along with other important libraries for the purpose of analyzing data with more ease. Pandas provides a dataframe object which makes it relatively easier to consider working with the data as it provides a tabular interface for the data in it. People who are already familiar in working with relational databases, they can really find similarities between a table in the database and the dataframe object in pandas.
Read more »Deploy serverless applications using the AWS SAM CLI
August 18, 2020In this article, we are going to learn to deploy serverless applications to the AWS Cloud using the AWS SAM CLI. This article is a part of the three-article series “Develop and Deploy Serverless Applications with AWS SAM CLI”. If you have some idea about how to develop and test your serverless applications locally using the AWS SAM CLI, then you might proceed with this article. However, if you want to learn more about developing and running your code locally, I would strongly recommend reading the previous articles of this series, Getting started with the AWS SAM CLI and Set up a local serverless environment using the AWS SAM CLI, which explains in detail the various configurations required to start and run the serverless functions on your local.
Read more »Set up a local serverless environment using the AWS SAM CLI
August 18, 2020In this article, we are going to work on setting up your local development environment for creating serverless applications using the AWS SAM CLI. This article is a part of the three-article series “Develop and Deploy Serverless Applications with AWS SAM CLI”. If you already know about the working principle of the AWS SAM CLI, you may proceed with this; otherwise, I would highly recommend reading my previous article on the series, Getting started with the AWS SAM CLI, where I talk about the introduction to the AWS Serverless Application Model and its workflow.
Read more »Power BI Visuals: Working with Filters
August 18, 2020Power BI is a data analytics tool that can be used to analyze data with the help of Power BI visuals.
Power BI is a Microsoft application and is available as a desktop application as well as a cloud service. It comes with a variety of visual and filtering options that can be used to create Power BI visuals.
Read more »Learn MySQL: Create and drop temp tables
August 18, 2020In this article, we are going to learn how to create a temp table and further drop these tables. The temporary tables are session-specific tables that are created within the session. When the session closes, the table is dropped by itself. A temporary table exists within a session only; therefore, a table created by one session is not visible to another session. For example, Session ID 501 has created a temporary table then session ID 502 cannot access it or manipulate it. Two different sessions can have a temporary table with the same name.
Read more »SQL Server troubleshooting: Disk I/O problems
August 17, 2020In this article, we will discuss how to resolve I/O problems that is a very important point for the SQL Server troubleshooting. The storage subsystem is one of the significant performance factors for the databases. Detecting and identifying I/O problems in SQL Server can be a tough task for the database administrators (DBAs). Generally, the underlying reasons for the I/O problems can be:
Read more »IT Cloud Automation using PowerShell
August 17, 2020Using PowerShell automation, one could easily automate the most common tasks. The future for PowerShell as the automation framework is bright. Shipping PowerShell core on the hybrid platform has opened up new markets, new customers, and new opportunities for Microsoft. At the same time, we still strongly believe in Powershell on Windows Server, Linux and macOS as a great combination for automation.
Read more »Getting started with the AWS SAM CLI
August 17, 2020In this article, we will learn the concept of the AWS SAM CLI. This is a part of the three-article series “Develop and Deploy Serverless Applications with AWS SAM CLI”. SAM, abbreviated for Serverless Application Model is a framework provided by Amazon Web Services, which can be leveraged to build applications on the local machine and deploy those to the AWS Lambdas directly.
Read more »Getting started with Jupyter Notebooks
August 14, 2020In this article, I am going to explain what Jupyter Notebooks are and how to install the same on your machine. Further, I will demonstrate how to use these notebooks using Visual Studio Code and perform data analysis and other development activities. It is an open-source platform using which you can create and share documents that contain live code, equations, and visualizations along with the formatted text. Most importantly, these notebooks can be run on the web browser by just starting a server and using it. This open-source project is maintained by the team at Project Jupyter.
Read more »Export data from AWS Redshift to AWS S3
August 14, 2020This article provides a step by step explanation of how to export data from the AWS Redshift database to AWS S3 using different export-related options.
Read more »Configure a SQL Server Always On Availability Group on the domain-independent Failover Cluster
August 13, 2020This article continues from the series on SQL Server Always On Availability Group. This is the 11th article in this series.
Read more »Data Engineer Interview Questions and Answers: SQL Workload Migration to Microsoft Azure Database Platforms
August 13, 2020In this article, we will discuss a number of questions that you may face when being interviewed to a Microsoft Azure Data Engineer position. These questions will focus on the process of migrating the SQL Server databases from the on-premises instances to the Microsoft Azure database services.
Read more »Java Language Extensions in SQL Server 2019
August 13, 2020In this article, we will discuss SQL Server 2019 new feature—Java Language Extensions. With the advent of SQL Server 2019, Microsoft always strives to expand its footprint on the capabilities of MLS (Machine Learning Services). It builds a deeper integration between the data-platform and data science under the data science umbrella. The Microsoft SQL Server 2019 MLS extensibility framework provides a solid base for allowing extensions in R, Python, and now Java.
Read more »Visual Studio Code for MySQL and MariaDB development
August 13, 2020In this article, I’ll walk you through setting up Visual Studio Code for MySQL and MariaDB development using a third-party VS Code extension and give an overview of the basic features.
Read more »Export data from MySQL tables to Azure SQL database
August 12, 2020In this article, I am going to explain how we can export the data of the on-premise MySQL database to Azure SQL database. This task can be performed in two phases.
Read more »Deploy a domain-independent Windows Failover Cluster for SQL Server Always On Availability Groups
August 12, 2020This is the 10th article in the series for SQL Server Always On Availability Groups.
Read more »SQL database hotfix testing with tSQLt
August 10, 2020This article talks about getting your database hotfixes tested with tSQLt provided they do not have any inherited complexities or dependencies on things other than SQL database.
Read more »SQL Certifications
August 7, 2020Introduction
Many people ask me how to get the Microsoft SQL Certification. SQL Server has a lot of certifications and specializations. In this article, we will provide an introduction to each of them and provide some tips related. At the time of this publication, we are under the Coronavirus era. Many people are at home with free time. Instead of watching all the bad COVID 19 news, it is a great idea to earn a new certification.
Read more »Learn MySQL: Add data in tables using the INSERT statement
August 7, 2020In my previous article, Learn MySQL: Sorting and Filtering data in a table, we had learned about the sorting and filtering of the data using WHERE and ORDER BY clause.
Read more »Backup SQL databases to Azure using the database maintenance plan
August 6, 2020In this article, we are going to learn how we can back up the SQL database to Azure using a database maintenance plan. To demonstrate the process, I have restored the AdventureWorks2017 database on my workstation. I have created an Azure container named sqlbackups in my storage account.
Read more »Power BI Visuals: Working with Treemaps and Tables
August 6, 2020In this article, you will learn how to work with Treemaps and Tables, which are two of the most commonly used Power BI visuals. You will also see how slicers can be used in Power BI to dynamically update the data in Treemaps and Tables. Power BI Visuals are extremely easy to create and don’t require you to write any code.
Read more »Getting started with Pandas in Python
August 5, 2020In this article, I am going to explain how to use Pandas in Python. Pandas is one of the most popular modules in python that can be used for data manipulation and analysis using python. Basically, it provides an easy interface to interact with flowing data and apply transformations to them on the go. This module is covered under the BSD license and can be used for free. You can download this module by visiting the website or by installing it through the python package manager.
Read more »Automatic Page Repair in SQL Server Always On Availability Groups
August 5, 2020This is the 9th article in the series of SQL Server Always On Availability Groups.
Read more »Configure ODBC drivers for MySQL
August 5, 2020In this article, I am going to explain ODBC drivers. We will go through the process to set up the ODBC driver for MySQL and use it to create an SSRS report. First, let me talk about ODBC drivers.
Read more »Migrating SQL workloads to Microsoft Azure: Databases trip to Azure SQL Database Managed Instance
August 5, 2020In the previous two trips of this articles series, databases trip to SQL Server on Azure VM and to Azure SQL Database, we discussed the benefits of migrating your on-premises SQL Server databases to the Microsoft Azure database platforms and the methods that can be followed to migrate the on-premises databases to the Azure database platforms.
Read more »