We will use here HAProxy which is an open-source HA load balancer and proxy server for TCP and HTTP based applications. Ngnix is not recommended as we do not have webserver traffic to load balance. Let’s first install HAProxy on the proxy server. yum -y inst…

In today’s market there is range of affordable to high-end and low-end computers that are loaded with variety of specs. The purpose of this article is to measure the performance of computer of your choice using diagnostics tests to measure different performance metric…

First let’s understand the 3 different roles of disk i.e. the data disk, the OS disk, and the temporary disk.  A data disk is a managed disk that's attached to a virtual machine to store application data, or other data you need to keep.  OS disk has pre-insta…

If you need to capture a network trace/TCP Dump of a client or server here are some simple ways using which usually I do this: Capture fiddler trace    1) Install Fiddler from http://www.telerik.com/download/fiddler/fiddler4 if not already done    2) Launch fid…

Step1 . Created ECS and RDS instance Open port 80 on ECS for web traffic Whitelisted ECS public IP (47.75.190.46) for RDS access Verify mysql connection from ECS

Use tags for your Azure resources, resource groups, and subscriptions to logically organize them into a taxonomy. Tag consists of a name and a value pair. To apply tags to a resource, you must have write access to the Microsoft.Resources/tags resource type. Many Az…

Installing a Hadoop cluster typically involves unpacking the software on all the machines in the cluster or installing it via a packaging system as appropriate for your operating system. It is important to divide up the hardware into functions. Typically one machin…

When we install hadoop we get few jars to test the installation and for benchmarking. In Cloudera distribution: /opt/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.875250/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar /opt/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.…

Apache is available within CentOS’s default software repositories, which means you can install it with the  yum  package manager. yum install -y httpd You might need to allow HTTP(port 80) and HTTPS (port 443) from firewall, use below:

Download Apache tomcat 9.0 wget https://www-us.apache.org/dist/tomcat/tomcat-9/v9.0.19/bin/apache-tomcat-9.0.19.tar.gz Extract the Tomcat archive and move it to your desired (/opt/tomcat) directory. tar -zxvf apache-tomcat-*.tar.gz mv apache-tomcat-*/* /…

Step1: Apache Spark requires Java 8, so make sure you have it before you start Step2. C:\>java -version java version "1.8.0_231" Java(TM) SE Runtime Environment (build 1.8.0_231-b32) Java HotSpot(TM) Client VM (build 25.231-b32, mixed mode) …

STEP1: Use SSH to connect to the public IP address of the virtual machine. Replace sshuser with the SSH user account you specified when creating the VM. The following example connects to a virtual machine at 40.68.254.142 : bash ssh sshuser@40.68.254.142

Nexus Repository OSS is an open source repository that supports many artifact formats, including Docker, Java™, and npm. To Install Nexus on Linux follow this document. Step1 : Before starting, Login to your Linux server and update it. Also install required utili…

Install Jenkins Step1 : Before starting, Login to your Linux server and update it. Also install required utilities and JDK sudo yum update -y sudo yum install wget -y sudo yum install java-1.8.0-openjdk.x86_64 -y Step2 : To install Jenkins, First you…

RPC server stores authorization in relation database. Apache Sentry is a granular, role-based authorization module for Hadoop. Sentry provides the ability to control and enforce precise levels of privileges on data for authenticated users and applications on a Hadoo…

Change Time to EST Update Timezone, follow prompt: sudo dpkg-reconfigure tzdata *Select US -> Eastern First thing First.   Update/upgrade sudo apt-get update sudo apt-get upgrade

How to setup Hadoop in Mac OS Follow below steps to install Hadoop on your Mac. Step 1- Download Hadoop 1.0.3 from the Apache site .