This article will cover testing or verification aspects of Type 2 Slowly Changing Dimensions in a Data Warehouse.
Read more »Dinesh Asanka
- Testing Type 2 Slowly Changing Dimensions in a Data Warehouse - May 30, 2022
- Incremental Data Extraction for ETL using Database Snapshots - January 10, 2022
- Use Replication to improve the ETL process in SQL Server - November 4, 2021
Incremental Data Extraction for ETL using Database Snapshots
January 10, 2022This article is to explain how to perform ETL using database snapshots and how to utilize database snapshots to perform incremental data extraction from an operational database to a data warehouse.
Read more »Use Replication to improve the ETL process in SQL Server
November 4, 2021Introduction
This article describes how to improve the ETL Process in SQL Server by using the native replication technique in SQL Server.
Read more »Text Classification in Azure Machine Learning using Word Vectors
October 1, 2021This article discusses how to perform Text classification in Azure Machine using a popular word vector technique in Text Mining. This article is part of the Azure Machine learning series during which we have discussed many aspects such as data cleaning and feature selection techniques of Machine Learning. We further discussed how to perform classification in Azure Machine Learning and we will be utilizing some of those experiences here. Further, we have discussed several machine learning tasks in Azure Machine Learning such as Clustering, Regression, Recommender System and Time Series Anomaly Detection. With respect to text mining, we have discussed techniques such as Language Detection, Named Entity Recognition, LDA, Text Recommendations, etc.
Read more »Building Ensemble Classifiers in Azure Machine Learning
September 21, 2021Introduction
This article is the newest addition to the article series of Azure Machine Learning which is Ensemble classifiers in Azure Machine Learning. During this article discussion, we have focused on data cleaning and feature selection techniques of Machine Learning. Further, we have discussed several machine learning tasks in Azure Machine Learning such as Classification, Clustering, Regression, Recommender System and Time Series Anomaly Detection. Further, we discussed AutoML features that are available with Azure Machine Learning Services. In the AutoML techniques, we have identified how to utilize Classification in AutoML. This article is an extension of the classification techniques that we discussed before.
Read more »Implementing Slowly Changing Dimensions (SCDs) in Data Warehouses
September 3, 2021Introduction
Slowly Changing Dimensions in Data Warehouse is an important concept that is used to enable the historic aspect of data in an analytical system. As you know, the data warehouse is used to analyze historical data, it is essential to store the different states of data.
Read more »Internals of Physical Join Operators (Nested Loops Join, Hash Match Join & Merge Join) in SQL Server
August 30, 2021Introduction
There are three types of physical join operators in SQL Server, namely Nested Loops Join, Hash Match Join, and Merge Join. In this article, we will be discussing how these physical join operators are working and what are the best practices for these different joins.
Read more »AutoML in Azure Machine Learning for Regression and Time Series
August 16, 2021Introduction
AutoML in Azure Machine Learning is used to build machine learning models on its own as we discussed in the previous article. Over there, we discussed what AutoML is and how to develop classification models in AutoML using Azure Machine Learning. This article will be dedicated to the discussion about building machine learning models using AutoML for Clustering and Time Series tasks.
Read more »AutoML in Azure Machine Learning
August 10, 2021Introduction
In this article, we are going to discuss AutoML in Azure Machine Learning Service. During our previous discussions, we had discussed features of Azure Machine Learning (Classic) and in this article, we are moving our discussion to Azure Machine Learning service.
Read more »Recommender Systems for Customer Reviews
July 29, 2021Introduction
Until now, we have discussed several topics in Text Analytics in Azure Machine Learning in many aspects from the last couple of articles and in this article, we will be discussing the Recommender Systems for Customer Reviews.
Read more »Latent Dirichlet Allocation in Text Analytics
July 8, 2021Introduction
Until now, we have discussed a few topics in Analytics in Azure Machine Learning many aspects in the last couple of articles, we will be discussing the Latent Dirichlet Allocation in Text Analytics in this article.
Read more »Filter based Feature Selection in Text Analytics
July 1, 2021Introduction
As we are well into the discussions of Text Analytics in Azure Machine Learning from the last couple of articles, we will be discussing the Filter based Feature Selection in Text Analytics and how we can build a prediction model from the Filter Based Feature Selection in order to perform text classification.
Read more »Common Table Expressions for Database Developers
June 24, 2021Introduction
Though the Common Table Expressions (CTE) were introduced to SQL Server more than a decade ago with the SQL Server 2005 version, still this is not much utilized by database developers due to the unawareness. This article provides what and how you can utilize the CTE effectively and efficiently.
Read more »GROUP BY ROLLUP for Data Analysis
June 23, 2021Introduction
In this article, we are looking at T-SQL commands of GROUP BY ROLLUP to aggregate data and improve the data analytical capabilities in SQL Server.
Read more »Azure Machine Learning: Named Entity Recognition in Text Analytics
May 13, 2021Introduction
After starting our discussions into Text Analytics in Azure Machine Learning from the last article, we will be discussing the Named Entity Recognition control in Azure Machine Learning in this article.
Read more »Managing SQL Server Express databases
May 11, 2021Introduction
If you are not able to spend money on your small databases, SQL Server Express edition is the solution for you. This edition will provide you with a basic storage option and this article is to examine what maintenance tasks you need to perform to manage SQL Express effectively.
Read more »Things you should avoid when designing a Data Warehouse
April 28, 2021Introduction
Since data warehouse is an important element in the data strategy of any organization, it is essential to take necessary actions during designing a Data Warehouse. There are several different designing patterns in a data warehouse, in this article, we will look at what you should avoid during the data warehouse designing.
Read more »Language Detection in Azure Machine Learning with basic Text Analytics Techniques
April 26, 2021After discussing a wide range of aspects in Azure Machine Learning, now it is time to move into a new area, Text Analytics and we have dedicated this article to Language Detection in Azure Machine Learning for Text Analytics.
Read more »Designing Recommender Systems in Azure Machine Learning
April 13, 2021In this article, we will be discussing how to design a Recommender System in Azure Machine learning which is the next article in the Azure Machine Learning series. During this lengthy article series on Azure Machine Learning, we have discussed multiple machine learning techniques such as Regression analysis, Classification Analysis, Clustering and Anomaly detection of Time Series. Further, we have discussed the basic cleaning techniques, feature selection techniques and Principal component analysis, Comparing Models and Cross-Validation and Hyper Tune parameters in this article series to date.
Read more »Multi-language support for SSAS
April 8, 2021Introduction
After discussing many features in SQL Server Analysis Services (SSAS) in order to carry out much richer analytics activities, we are going to discuss another feature in SSAS named Multi-language support for SSAS. In a previous article, we discussed how to create SSAS OLAP Cubes and how to access the OLAP cube using Excel. Further, we discussed how to include hierarchies in SSAS in order to improve the data analysis capabilities. In addition to those features, we discussed how to create perspectives in OLAP Cubes and how to perform management activities in SSAS.
Read more »Time Series Anomaly Detection in Azure Machine Learning
April 1, 2021In this article, we will be discussing how to use Time Series Anomaly Detection in Azure Machine Learning and this article comes next in the Azure Machine Learning series. During this article series on Azure Machine Learning, we have discussed multiple machine learning techniques such as Regression analysis, Classification Analysis and Clustering. Further, we have discussed the basic cleaning techniques, feature selection techniques and Principal component analysis, Comparing Models and Cross-Validation and Hyper Tune parameters until today in this article series.
Read more »Tune Model Hyperparameters for Azure Machine Learning models
March 25, 2021Introduction
In this article, we will be discussing how to Tune Model Hyperparameters to choose the best parameters for Azure Machine Learning models. During this article series on Azure Machine Learning, we have discussed multiple machine learning techniques such as Regression analysis, Classification Analysis and Clustering. Further, we have discussed the basic cleaning techniques, feature selection techniques and Principal component analysis, Comparing Models and Cross-Validation until today in this article series.
Read more »Customizing Differential and Transaction Log backups
March 10, 2021Introduction
This article is dedicated to creating custom differential and Transaction log backups so that you will see sufficient data in the file size. In SQL Server there are mainly three backup types, Full Backup, Differential Backup, and Transactional Log backups. A Full backup will get the entire database into a backup.
Read more »Elastic Jobs in Azure SQL Database
February 18, 2021Introduction
I have dedicated this article to the topic of Elastic Jobs in Azure SQL Database which is in Public Review. This feature allows you to run scheduled tasks in your Azure SQL Databases. This is similar to SQL Server Agent you have in the On-prem SQL Server versions. However, in Elastic Jobs, you can execute the scheduled tasks in multiple Azure SQL Servers and multiple Databases which is an added advantage when considering the features of SQL Server Agent. Further, this execution performs parallelly.
Read more »Dynamic Data Masking in SQL Server
February 2, 2021Introduction
In this article, we will be looking at how to perform and access Dynamic Data Masking in SQL Server. Data Masking is the process of hiding data with different rules. One of the main reasons to apply data masking is to protect Personal Identifiable Information (PII) and sensitive data from unauthorized access. Even when unauthorized users access these data, they will not be able to view the actual values. This article will look at the possibilities of applying Dynamic Data Masking in SQL Server and we will look at how Dynamic Data masking can be applied to the Azure SQL Databases as well.
Read more »