Anomaly Detection is a very powerful pattern and mostly, 70% time used. Azure Stream Analytics is having built-in ML-based Anomaly detection. It is based on the Un-supervised learning model i.e. model does not come with any pre-training, it starts learning with no o…

This article is extend of my previous post “ Real-Time Data Stream Processing in Azure Part: 1 ” on real time analytics. Before I start the core for which you started reading this blog, lets quickly review few basic concepts for Stream Analytics.

There are multiple ways to do real time analytics on Azure, depends on source type and the analytics which we want to perform. This article will introduce the major services in Azure which are involved for real time data solution and at the end will compare all to kno…

Before I start details for Delta Architecture lets recap Lambda Architecture first, then you will be able to appreciate the beauty of delta Architecture. Lambda architecture is a popular technique where records are processed by a batch system and streaming system…

Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spark and big data workloads. Delta Lake offers: ACID Transactions Scalable Metadata Handling Time Travel (data versioning) Open Format Unified Batch and Streaming Sou…

One of the cool feature of cloud is easy to adapt cutting edge technologies. A modern data warehouse(MDW) lets you bring together all your data at any scale easily, and means you can get insights through analytical dashboards, operational reports or advanced analytics…