Lambda vs Delta Architecture - Realtime Analytics on Delta Lake

Before I start details for Delta Architecture lets recap Lambda Architecture first, then you will be able to appreciate the beauty of delta Architecture. Lambda architecture is a popular technique where records are processed by a batch system and streaming system…

Read more

Delta Lake in Apache Spark - Basics

Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spark and big data workloads. Delta Lake offers: ACID Transactions Scalable Metadata Handling Time Travel (data versioning) Open Format Unified Batch and Streaming Sou…

Read more

Azure Synapse Architecture

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics.  It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale. SQL Analytics u…

Read more

Design Modern Data Warehouse using Azure Synapse and Azure Databrciks

One of the cool feature of cloud is easy to adapt cutting edge technologies. A modern data warehouse(MDW) lets you bring together all your data at any scale easily, and means you can get insights through analytical dashboards, operational reports or advanced analytics…

Read more

Logic App to Refresh / Calculate / Sync Azure Analysis Services models

In this post, I will show how you can perform automated Refresh / Calculate / Sync the Azure Analysis Services models in one go by using Logic Apps and REST calls. Some of pros of using Logic App, apart from being so handy and ready to use enterprise connectors a…

Read more

Benchmark Windows System

In today’s market there is range of affordable to high-end and low-end computers that are loaded with variety of specs. The purpose of this article is to measure the performance of computer of your choice using diagnostics tests to measure different performance metric…

Read more

How to Secure Azure Analysis Services and Azure Synapse?

Azure Analysis Services is a fully managed platform as a service (PaaS) that provides enterprise-grade data models in the cloud. Use advanced mashup and modeling features to combine data from multiple data sources, define metrics, and secure your data in a single, tru…

Read more

How to expand Linux OS Disk

First let’s understand the 3 different roles of disk i.e. the data disk, the OS disk, and the temporary disk.  A data disk is a managed disk that's attached to a virtual machine to store application data, or other data you need to keep.  OS disk has pre-insta…

Read more

Benchmarking of Relational DB

To show benchmarking, below General Purpose mysql RDS created SHOW VARIABLES  LIKE   "%version%" ;

Read more

Capture a Network Trace

If you need to capture a network trace/TCP Dump of a client or server here are some simple ways using which usually I do this: Capture fiddler trace    1) Install Fiddler from http://www.telerik.com/download/fiddler/fiddler4 if not already done    2) Launch fid…

Read more

Benchmarking Network Performance

Tool Used: iperf First Instance ECS on Cloud: root@iZj6c5vmzbgujq3xi2m45aZ:~#  phoronix-test-suite system-info Phoronix Test Suite v5.2.1 System Information Hardware: Processor: Intel Xeon E5-2682 v4 @ 2.50GHz (1 Core), Motherboard: Alibaba Cloud…

Read more

Performance Benchmarking CPU

Tool Used: sysbench, Phoronix Test Suite First Instance ECS on Cloud: root@iZj6c5vmzbgujq3xi2m45aZ:~# phoronix-test-suite system-info Phoronix Test Suite v5.2.1 System Information Hardware: Processor: Intel Xeon E5-2682 v4 @ 2.50GHz (1 Core), Mot…

Read more

Performance Benchmarking Memory

Tool Used:  sysbench, Phoronix Test Suite First Instance ECS on Cloud: root@iZj6c5vmzbgujq3xi2m45aZ:~#  phoronix-test-suite system-info Phoronix Test Suite v5.2.1 System Information Hardware: Processor: Intel Xeon E5-2682 v4 @ 2.50GHz (1 Core), M…

Read more

Performance Benchmarking Disk IO

Tool Used: sysbench, Phoronix Test Suite First Instance ECS on Cloud: root@iZj6c5vmzbgujq3xi2m45aZ:~# phoronix-test-suite system-info Phoronix Test Suite v5.2.1 System Information Hardware: Processor: Intel Xeon E5-2682 v4 @ 2.50GHz (1 Core), Mot…

Read more

List all available test in Phoronix Test Suite

For those who wants to know the current list of benchmarking available for windows in PTS, I am listing whole result here: $ phoronix-test-suite list-available-tests    OR 1:   Run A Test / Benchmark 2:   Run A Suite       [A Collection Of Tests] 3:…

Read more

Install WordPress on LAMP server

Step1 . Created ECS and RDS instance Open port 80 on ECS for web traffic Whitelisted ECS public IP (47.75.190.46) for RDS access Verify mysql connection from ECS

Read more

Lock resources to prevent unexpected changes using Powershell or Azure CLI

You may need to lock a subscription, resource group, or resource to prevent other users in your organization from accidentally deleting or modifying critical resources. You can set the lock level to CanNotDelete or ReadOnly. In the portal, the locks are called Delete …

Read more

Manage Azure Tags using PowerShell or Azure CLI

Use tags for your Azure resources, resource groups, and subscriptions to logically organize them into a taxonomy. Tag consists of a name and a value pair. To apply tags to a resource, you must have write access to the Microsoft.Resources/tags resource type. Many Az…

Read more

How to implement Row-Level Security in Azure SQL Database or SQL Server

Some one of you prefer view-based workarounds for row-level filtering. The benefits of using Row-Level Security (RLS) instead of views include: RLS reduces code complexity by centralizing access logic in a security policy and eliminating the need for an ex…

Read more

Manage Azure RBAC using Power Shell

Azure role-based access control (Azure RBAC) helps you manage who has access to Azure resources, what they can do with those resources, and what areas they have access to. Before we start first review basics from Microsoft document on RBAC here . Like one of the impo…

Read more