List of DevOps Tools

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/ 

 

 OS:     Linux, Windows, Mac

Scripting: ShellScript, PowerShell, Perl, Python, Go Lang, Groovy... etc.

Source Code Management (SCM)Tools:   GitHub, GitLab, BitBucket, Azure Repos, AWS Code Commit, CVS, TFS, SVN... etc

Build Tools:   

       Java Build Tools: Ant, Maven and Gradle 

      Python: PyBuilder

      .Net Build Tools:    Nant, MS Build 

      Apache Scala: Scala Build Tool (SBT)

      C : Make     

      C++: CMake  

      NodeJs: Gulp, Grunt     

 Application Servers:    Apache Tomcat, JBoss, Wildfly,  WebSphere Application Server (WAS), WebSphere Liberty Profile ( WLP), Weblogic, GlassFish

 Web Servers:   Apache HTTP Server, Nginx (Engine X) , Oracle iPlanet  Webserver (OiWS), Microsoft IIS (Internet Information Services), Oracle HTTP Server (OHS), IBM HTTP Server (IHS)        

Static  Code Analysis / Static  Code Quality Management Tools:  Sonarqube, Veracode, HP Fortify , Checkstyle , FindBugs      

 Artifact Repositories: Nexus, JFrog Artifactory , AWS CodeArtifact, Azure Artifacts, Go Registry   (Google Artifact Registry)  

Continuous Integration Tools/Continuous Deployment Tools:  Jenkins, Bamboo, Cloudbees Jenkins, Circle CI, Travis CI, TeamCity, AzureDevOps, AWS CodePipeline , AWS CodeDeploy, GitHub Actions, Gitlab CI, Spinnaker, Argo CD..          

Configuration Management Tools:  Ansible, Chef, Puppet, SaltStack     

Cloud Service Providers (CSPs):  Amazon Web Services(AWS), Microsoft Azure, Google Cloud Platform(GCP), IBM Cloud, Oracle Cloud, DigitalOcean, Alibaba Cloud, Cisco Cloud Solutions            

Containerization Tools:   Docker, Container D, Podman  

 Container Orchestration Tools: Docker Swarm, Kubernetes, Azure Kubernetes Service (AKS), Amazon Elastic Kubernetes Service (EKS) , Hashicrop Nomad, Google Kubernetes Engine (GKE) , Digital Ocean Kubernetes... etc

 Monitoring Tools: 

  a) Application Monitoring Tools:  NewRelic, AppDynamics, Datadog, Prometheus and Grafana(GUI for Logs) , SolarWinds  , Datadog,     

  b) Log Monitoring Tools:  Splunk,  Logentries, ELK Stack(Elastic Search - Logstash -  Kibana), Fluentd,                   

 Ticketing Tools:   Jira Service management, ServiceNow,   IBM Rational team concert (RTC), AzureDesk,      

 Communication Tools:  Microsoft Teams, Slack, Skype or Business , Lync, SameTime

 

                    

 

Nexus Server Installation in Ubuntu Linux Server - Mithun Technologies - +91-99809 23226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/ 

Note: As of release 3.78.0, the Unix archive comes bundled with a platform-specific JDK. This means that the Unix archive cannot be used on a Mac. No need to install Java.
 

Login as a root user
sudo su -
cd /opt
wget https://download.sonatype.com/nexus/3/nexus-unix-x86-64-3.78.0-14.tar.gz
tar -xvf nexus-unix-x86-64-3.78.0-14.tar.gz
mv nexus-3.78.0-14 nexus

#As a good security practice, Nexus is not advised to run nexus service as a root user, so create a new user called nexus and grant sudo access to manage nexus services as follows.
 
useradd nexus

#Give the sudo access to nexus user

visudo
nexus ALL=(ALL) NOPASSWD: ALL

#Change the owner and group permissions to /opt/nexus and /opt/sonatype-work directories.

chown -R nexus:nexus /opt/nexus
chown -R nexus:nexus /opt/sonatype-work
chmod -R 775 /opt/nexus
chmod -R 775 /opt/sonatype-work

#Open /opt/nexus/bin/nexus.rc file and  uncomment run_as_user parameter and set as nexus user.

vi /opt/nexus/bin/nexus.rc
run_as_user="nexus"

#Create nexus as a service

ln -s /opt/nexus/bin/nexus /etc/init.d/nexus

#Switch as a nexus user and start the nexus service as follows.

sudo su - nexus

#Enable the nexus services
sudo systemctl enable nexus

#Start the nexus service
sudo systemctl start nexus

#Check  the nexus service status
sudo systemctl status nexus

#Access the Nexus server from Laptop/Desktop browser.

 

http://IPAddess/Hostname:8081/

#Default Credentials

User Name:

Password:

Troubleshooting
---------------------
nexus service is not starting?

a)make sure need to change the ownership and group to /opt/nexus and /opt/sonatype-work directories and permissions (775) for nexus user.
b)make sure you are trying to start nexus service with nexus user.
c)check java is installed or not using java -version command.
d) check the nexus.log file which is availabe in  /opt/sonatype-work/nexus3/log  directory.

Unable to access nexus URL?
-------------------------------------
a)make sure port 8081 is opened in security groups in AWS ec2 instance.

 

 

Ansible Installation in Amazon Linux - Mithun Technologies - 9980923226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/ 
Ansible Installation  in Amazon Linux

 

 

 

sudo yum install python3 -y

sudo yum install python-pip

pip install ansible

pip install boto3
pip install botocore
 

Oracle Java Installation - Linux - Mithun Technologies - 9980923226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/ 

Java Installation  in RHEL

#Login as a root user
sudo su -

##Change dir to /opt
cd /opt
yum install wget -y
wget -c --header "Cookie: oraclelicense=accept-securebackup-cookie" http://download.oracle.com/otn-pub/java/jdk/8u131-b11/d54c1d3a095b4ff2b6607d096fa80163/jdk-8u131-linux-x64.rpm
yum install jdk-8u131-linux-x64.rpm -y

java -version

 

 

Jenkins Installation in RedHat Linux Server - Mithun Technologies - 9980923226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/ 

Jenkins Installation in RedHat Linux Server

 

 sudo su -

yum install wget -y

wget -O /etc/yum.repos.d/jenkins.repo https://pkg.jenkins.io/redhat-stable/jenkins.repo

rpm --import https://pkg.jenkins.io/redhat-stable/jenkins.io.key

yum install fontconfig java-11-openjdk -y

yum install jenkins -y

systemctl enable jenkins

systemctl start jenkins

systemctl status jenkins

Install Nginx HTTP server by using specific version package - RHEL 8 - Mithun Technologies - 9980923226

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Nginx HTTP Server Installation

 Method 3

#Login as root user and execute the below command for install nginx http server.

sudo su -

1. yum -y install wget
2. wget https://nginx.org/packages/rhel/6Server/x86_64/RPMS/nginx-1.18.0-2.el6.ngx.x86_64.rpm
3. yum install nginx-1.18.0-2.el6.ngx.x86_64.rpm
4. systemctl start nginx
5. systemctl enable nginx
6. nginx -V

Given User is root user or not.. - Mithun Technologies - +91 99809 23226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 Write a Shellscript to given user is root user or not

#!/bin/bash      
#title                :
#description     :
#author             : Mithun Technologies
#date                : 08112012
#version           : 2.0    
#usage             :
#Copy Rights   : Mithun Technologies
#Contact          : 9980923226

echo "Please enter the user name"
read userName

if [ `id -u $userName` -eq 0 ]
then
echo "Give user is root user"
else
echo "Given user is not root user"
fi

JBoss/Wildfly Installation in RedHat Linux Server - Mithun Technologies - +91 99809 23226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

  JBoss/Wildfly  Installation in RedHat Linux Server

Login As a root user

sudo su -

cd /opt

wget https://github.com/wildfly/wildfly/releases/download/25.0.1.Final/wildfly-preview-25.0.1.Final.zip

unzip wildfly-preview-25.0.1.Final.zip

cd /opt/wildfly-<<Version>>.Final/standalone/configuration/

cd /opt/wildfly-preview-25.0.1.Final/standalone/configuration/

Find and replace 127.0.0.1 with your Private IP address in standalone.xml like below

vim /opt/wildfly-13.0.0.Final/standalone/configuration/standalone.xml
<wsdl-host>${jboss.bind.address:172.31.24.62}</wsdl-host>
<inet-address value="${jboss.bind.address.management:172.31.24.62}"/>
<inet-address value="${jboss.bind.address:172.31.24.62}"/>

sh /opt/wildfly-preview-25.0.1.Final/bin/add-user.sh
sh /opt/wildfly-preview-25.0.1.Final/bin/standalone.sh

Tekton Dashboard Installation in RedHat Linux Server - Mithun Technologies - +91 99809 23226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Tekton Dashboard in RedHat Linux Server

 To Install Tekton Dashboard first we need to create a cluster. To create a cluster we can use Kubernetes.

First Create a Kubernetes Cluster using below steps.

For SELinux is disabling
setenforce 0

For SELinux is disabling permanently

sed -i --follow-symlinks 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/sysconfig/selinux

Enable the Ports, if not enabled, by using below commands.

 firewall-cmd --permanent --add-port=6443/tcp
 firewall-cmd --permanent --add-port=2379-2380/tcp
 firewall-cmd --permanent --add-port=10250/tcp
 firewall-cmd --permanent --add-port=10251/tcp
 firewall-cmd --permanent --add-port=10252/tcp
 firewall-cmd --permanent --add-port=10255/tcp
 firewall-cmd --reload
 
 modprobe br_netfilter
 echo '1' > /proc/sys/net/bridge/bridge-nf-call-iptables
 

cat <<EOF > /etc/yum.repos.d/kubernetes.repo
[kubernetes]
name=Kubernetes
baseurl=https://packages.cloud.google.com/yum/repos/kubernetes-el7-x86_64
enabled=1
gpgcheck=1
repo_gpgcheck=1
gpgkey=https://packages.cloud.google.com/yum/doc/yum-key.gpg https://packages.cloud.google.com/yum/doc/rpm-package-key.gpg
EOF


yum install -y kubelet kubeadm  kubectl

systemctl restart docker && systemctl enable docker

systemctl  restart kubelet && systemctl enable kubelet


Note: Before executing above command need to disable swap memory by using below command

swapoff -a : Temporarly

sed -i '/ swap / s/^\(.*\)$/#\1/g' /etc/fstab : permanently


vi kubeadm-config.yaml

# kubeadm-config.yaml
kind: ClusterConfiguration
apiVersion: kubeadm.k8s.io/v1beta3
kubernetesVersion: v1.22.3
---
kind: KubeletConfiguration
apiVersion: kubelet.config.k8s.io/v1beta1
cgroupDriver: cgroupfs


kubeadm init --config kubeadm-config.yaml


Switch to tekton normal user and execute below commands

  mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config

kubectl apply -f "https://cloud.weave.works/k8s/net?k8s-version=$(kubectl version | base64 | tr -d '\n')"


kubectl taint node footslog1.fyre.ibm.com node-role.kubernetes.io/master:NoSchedule-

kubectl run nginx-demo --image=nginx --port=80
 
kubectl expose pod nginx-demo --port=80 --type=NodePort

kubectl apply --filename https://storage.googleapis.com/tekton-releases/pipeline/latest/release.yaml
kubectl apply --filename https://storage.googleapis.com/tekton-releases/dashboard/latest/tekton-dashboard-release.yaml

kubectl get pods --namespace tekton-pipelines --watch

Note: Hit CTRL+C to stop monitoring.

kubectl edit svc tekton-dashboard -n tekton-pipelines

type: ClusterIP --> type: NodePort


Uninstalling the Dashboard on Kubernetes

The Dashboard can be uninstalled by running the following command:

kubectl delete --filename https://storage.googleapis.com/tekton-releases/dashboard/latest/tekton-dashboard-release.yaml

Tekton CLI Installation - Mithun Technologies - +91 99809 23226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Tekton CLI in MAC Book 

 

Tekton provides a CLI, tkn, for easier interaction with Tekton components.

 

a) Tekton CLI Installation in MAC Book

 

Open the terminal and execute the below commands

#brew tap tektoncd/tools

#brew install tektoncd/tools/tektoncd-cli

 

#tkn version

 

 

 

 

Tekton Dashboard Installation in MAC Book - Mithun Technologies - +91 99809 23226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Tekton Dashboard  in MAC Book

To Install Tekton Dashboard first we need to create a cluster. To create a cluster we can kind tool.

Kind is a tool for running local Kubernetes clusters using Docker container “nodes”.

To install a kind, first we should install docker in our laptop.


To install kind in MAC book follow the below command.

#brew install kind

To check the version
#kind version


To Create a Kubernetes cluster use the below commands

#kind create cluster --name tektondemo : It will create a cluster with name 'tektondemo'

##Deleting a Cluster 
##kind delete cluster --name tektondemo 

To display the nodes
#kubectl get nodes

To Display all the pods.
#kubectl get pod -A 

To create a namespace with the name 'tekton-pipelines'

#kubectl create ns tekton-pipelines

To install the latest version of  Tekton Dashboard.
#kubectl apply --filename https://storage.googleapis.com/tekton-releases/dashboard/latest/tekton-dashboard-release.yaml 

#kubectl apply --filename https://github.com/tektoncd/pipeline/releases/download/v0.16.1/release.notags.yaml

#kubectl get pods --namespace tekton-pipelines --watch

Note: Hit CTRL+C to stop monitoring.

#kubectl get all -n tekton-pipelines

Accessing the Dashboard
-----------------------

By using  kubectl port-forward
------------------------------

#kubectl --namespace tekton-pipelines port-forward svc/tekton-dashboard 9097:9097

Install Pipeline
----------------
Tekton Dashboard requires to have Tekton Pipelines installed.
Installing the latest Tekton Pipelines release is done by running the following command:

#kubectl apply --filename https://storage.googleapis.com/tekton-releases/pipeline/latest/release.yaml

Uninstalling the Dashboard on Kubernetes
----------------------------------------
kubectl delete --filename https://storage.googleapis.com/tekton-releases/dashboard/latest/tekton-dashboard-release.yaml

Tekton Dashboard extensions
---------------------------

Follow below url for Extensions 
https://github.com/tektoncd/dashboard/blob/main/docs/extensions.md

Tekton Playground

 

https://katacoda.com/tektoncd

 

References

https://tekton.dev/docs/

https://github.com/tektoncd/dashboard/blob/main/docs/walkthrough/walkthrough-kind.md

https://github.com/tektoncd/cli/tree/main/docs

https://kind.sigs.k8s.io/

https://github.com/GoogleContainerTools/kaniko

 

 

 

 

 

Argo CLI Installation using Kubernetes - Mithun Technologies - +91 99809 23226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Agro CLI using Kubernetes

kubectl create namespace argo
kubectl apply -n argo -f https://github.com/argoproj/argo-workflows/releases/download/v3.2.3/install.yaml

Argo CLI Installation in Linux Server - Mithun Technologies - +91 99809 23226

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

                                                     Install Agro CLI in Linux Server

# Download the binary
curl -sLO https://github.com/argoproj/argo-workflows/releases/download/v3.2.3/argo-linux-amd64.gz

# Unzip the software
gunzip argo-linux-amd64.gz

# Make binary executable
chmod +x argo-linux-amd64

# Move binary to path
mv ./argo-linux-amd64 /usr/local/bin/argo

# Test installation using below command
argo version

Argo CLI Installation in MAC Book - Mithun Technologies - +91 99809 23226

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Agro CLI in MAC Book

# Download the binary
curl -sLO https://github.com/argoproj/argo-workflows/releases/download/v3.2.3/argo-darwin-amd64.gz

# Unzip the software
gunzip argo-darwin-amd64.gz

# Make binary executable
chmod +x argo-darwin-amd64

# Move binary to path
mv ./argo-darwin-amd64 /usr/local/bin/argo

# Test installation using below command
argo version

Java Installation in Ubuntu Linux Server - Mithun Technologies - 9980923226

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/ 

Java Installation in Ubuntu Linux Server

 

 By default, Ubuntu 18.04 includes OpenJDK version 11,which is an open-source variant of the JRE and JDK.

To install this version, first update the package index with below command.

#sudo apt update

Then execute below commands based on which version you want to install.

#apt install default-jre : For Defauly version.
#apt install openjdk-11-jre-headless : For Java 11
#apt install openjdk-8-jre-headless : For Java 8

Verify the Java installation with below command.
#java -version

To install the JDK, execute the following command, which will also install the JRE.

#sudo apt install default-jdk

Verify that the JDK is installed by checking the version of javac, the Java compiler using below command.

#javac -version


To Install the Open JDK 8, use the below command.

#sudo apt install openjdk-8-jdk

Spark Installation in Linux Server - Mithun Technologies - 9980923226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Python in Linux Server

Login as a root user

sudo su -

wget https://www.apache.org/dyn/closer.lua/spark/spark-3.1.2/spark-3.1.2-bin-hadoop3.2.tgz

tar -zxvf spark-3.1.2-bin-hadoop3.2.tgz

ln -s /opt/spark-3.1.2-bin-hadoop3.2 /opt/spark

useradd spark

chown -R spark:spark /opt/spark*

vi /etc/systemd/system/spark-master.service

[Unit]
Description=Apache Spark Master
After=network.target

[Service]
Type=forking
User=spark
Group=spark
ExecStart=/opt/spark/sbin/start-master.sh
ExecStop=/opt/spark/sbin/stop-master.sh

[Install]
WantedBy=multi-user.target


vi /etc/systemd/system/spark-slave.service.service

[Unit]
Description=Apache Spark Slave
After=network.target

[Service]
Type=forking
User=spark
Group=spark
ExecStart=/opt/spark/sbin/start-slave.sh spark://rhel8lab.linuxconfig.org:7077
ExecStop=/opt/spark/sbin/stop-slave.sh

[Install]
WantedBy=multi-user.target


#systemctl daemon-reload

#systemctl start spark-master.service

#systemctl status spark-master.service

http://IpAddress:8080

JFrog CLI Install in Linux Server - Mithun Technologies - 9980923226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

JFrog CLI in Linux Server

Login as a root user

sudo su -

echo "[jfrog-cli]" > jfrog-cli.repo;
echo "name=jfrog-cli" >> jfrog-cli.repo;
echo "baseurl=https://releases.jfrog.io/artifactory/jfrog-rpms" >> jfrog-cli.repo;
echo "enabled=1" >> jfrog-cli.repo; echo "gpgcheck=0" >> jfrog-cli.repo;
sudo mv jfrog-cli.repo /etc/yum.repos.d/;
yum install -y jfrog-cli-v2;

JFrog CLI Installation in MAC
----------------------------------------

brew install jfrog-cli

To check the Version use the below command

jfrog -v

Reference URL

--------------------

https://jfrog.com/getcli/

Install Scala Build Tool (SBT) in Linux Server - Mithun Technologies - 9980923226

 

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Scala Build Tool (SBT) in Linux Server

Login as a root user  and execute the below commands

sudo su -

curl -L https://www.scala-sbt.org/sbt-rpm.repo > sbt-rpm.repo

sudo mv sbt-rpm.repo /etc/yum.repos.d/

sudo yum install sbt -y

sbt -version

Install Open Shift in Linux Server - Mithun Technologies - 9980923226

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Open Shift  in Linux Server

Login as a root user

sudo su -

For Downloading the OC 

--------------------------------
https://mirror.openshift.com/pub/openshift-v4/clients/ocp/latest/

wget https://mirror.openshift.com/pub/openshift-v4/clients/ocp/latest/openshift-install-linux-4.7.21.tar.gz

Extract the Package

--------------------------

tar -zxvf openshift-install-linux-4.7.21.tar.gz -O /usr/local/bin/

Copy the package into /usr/local/bin directory

---------------------------------------------------------
 

cp -r openshift-install /usr/local/bin/

 

Install Python in Linux Server - Mithun Technologies - 9980923226

Mithun Technologies            +91-9980923226              devopstrainingblr@gmail.com

                                                       http://mithuntechnologies.com/
                                                       http://mithuntechnologies.co.in/

 

Install Python in Linux Server

Login as a root user

sudo su -

Install the development group

yum groupinstall development -y

yum install wget tar -y
cd /opt

wget https://www.python.org/ftp/python/3.9.5/Python-3.9.5.tgz

tar -xvf Python-3.9.5.tgz

cd Python-3.9.5
./configure

sudo  make install

python3 --version

python --version

Install PIP

PIP is a package manager for Python packages, or modules if you like. Note: If you have Python version 3.4 or later, PIP is included by default.

 Download the PIP file

curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py

 Install PIP by using the below command

python3 get-pip.py

Check the PIP version

pip3 --version