First let’s understand the 3 different roles of disk i.e. the data disk, the OS disk, and the temporary disk.  A data disk is a managed disk that's attached to a virtual machine to store application data, or other data you need to keep.  OS disk has pre-insta…

Tool Used: iperf First Instance ECS on Cloud: root@iZj6c5vmzbgujq3xi2m45aZ:~#  phoronix-test-suite system-info Phoronix Test Suite v5.2.1 System Information Hardware: Processor: Intel Xeon E5-2682 v4 @ 2.50GHz (1 Core), Motherboard: Alibaba Cloud…

Tool Used: sysbench, Phoronix Test Suite First Instance ECS on Cloud: root@iZj6c5vmzbgujq3xi2m45aZ:~# phoronix-test-suite system-info Phoronix Test Suite v5.2.1 System Information Hardware: Processor: Intel Xeon E5-2682 v4 @ 2.50GHz (1 Core), Mot…

Tool Used:  sysbench, Phoronix Test Suite First Instance ECS on Cloud: root@iZj6c5vmzbgujq3xi2m45aZ:~#  phoronix-test-suite system-info Phoronix Test Suite v5.2.1 System Information Hardware: Processor: Intel Xeon E5-2682 v4 @ 2.50GHz (1 Core), M…

Tool Used: sysbench, Phoronix Test Suite First Instance ECS on Cloud: root@iZj6c5vmzbgujq3xi2m45aZ:~# phoronix-test-suite system-info Phoronix Test Suite v5.2.1 System Information Hardware: Processor: Intel Xeon E5-2682 v4 @ 2.50GHz (1 Core), Mot…

Installing a Hadoop cluster typically involves unpacking the software on all the machines in the cluster or installing it via a packaging system as appropriate for your operating system. It is important to divide up the hardware into functions. Typically one machin…

Security-Enhanced Linux (SELinux) is a Linux kernel security module that provides a mechanism for supporting access control security policies, including mandatory access controls (MAC).   Without SELinux enabled, only traditional discretionary access control (DAC) …

When we install hadoop we get few jars to test the installation and for benchmarking. In Cloudera distribution: /opt/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.875250/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar /opt/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.…

Apache is available within CentOS’s default software repositories, which means you can install it with the  yum  package manager. yum install -y httpd You might need to allow HTTP(port 80) and HTTPS (port 443) from firewall, use below:

Download Apache tomcat 9.0 wget https://www-us.apache.org/dist/tomcat/tomcat-9/v9.0.19/bin/apache-tomcat-9.0.19.tar.gz Extract the Tomcat archive and move it to your desired (/opt/tomcat) directory. tar -zxvf apache-tomcat-*.tar.gz mv apache-tomcat-*/* /…

If your application is giving error like below, or you want to increase user limit of open files, user limit of max processes follow this post. System Requirement: max file descriptors [4096] likely too low, increase to at least [65536]. To see the current limi…

Before start using ACL, make sure it is enable. If you are using Cloudera distribution use below property in HDFS configuration:     Alternatively you can find in yarn-site.xml

STEP1: Use SSH to connect to the public IP address of the virtual machine. Replace sshuser with the SSH user account you specified when creating the VM. The following example connects to a virtual machine at 40.68.254.142 : bash ssh sshuser@40.68.254.142

Nexus Repository OSS is an open source repository that supports many artifact formats, including Docker, Java™, and npm. To Install Nexus on Linux follow this document. Step1 : Before starting, Login to your Linux server and update it. Also install required utili…

Install Jenkins Step1 : Before starting, Login to your Linux server and update it. Also install required utilities and JDK sudo yum update -y sudo yum install wget -y sudo yum install java-1.8.0-openjdk.x86_64 -y Step2 : To install Jenkins, First you…

Hadoop cluster setup requires SSH key based authentication among master and slave nodes. Using SSH key based authentication, master node can connect to slave nodes or secondary nodes to start/stop the daemons\processes without any password.