DevOps Classroom Series – 14/Apr/2021

What are logs

• A log file records either events that occur in operatings or the software runs
• There are three kinds of logs
  • Event Log
  • Transactional logs
  • Message logs

Components of Elastic Stack

• Elastic Search: This stores all your data and provides search and analytics capabilities in scalable way

• Logstash:

  • This helps in centralizing event data such as logs, metrics and other data in any format.
  • This can perform transformation
  • This is a server side component.
  • Logstash enable collection of data from wide number of input sources and transforms and sends the logs to Elastic Search

• Kibana: This helps in providing visual interfaces to search the elastic search and provide analysis

• Beats:

  • This is complementary to logstash
  • Beats is a client side component.
  • Beats can read different logs and forward it to the logstash/elastic search

• X-pack:

  • This pack has features such as
    • security
    • monitoring
    • reporing
    • alerting
    • graph
    • machine learning

• Elastic Cloud: Elastic cloud is the hosted and managed setup of Elastic Stack components

pre-reqs

• Install necessary softwares Refer Here
• Install Windows Terminal Refer Here

Installing Elastic Stack

• Lets take one server an install elastic search and kibana in it.
• This server needs atleast 2 Vcpus and 4 GB of RAM
• This server will be a linux server with ubuntu distribution or centos distribution
• Installing elastic search on ubuntu Refer Here

wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add -
sudo apt-get install apt-transport-https
echo "deb https://artifacts.elastic.co/packages/7.x/apt stable main" | sudo tee /etc/apt/sources.list.d/elastic-7.x.list
sudo apt-get update && sudo apt-get install elasticsearch

• post configuration

sudo /bin/systemctl daemon-reload
sudo /bin/systemctl enable elasticsearch.service

• Installing elastic search on centos Refer Here
• Installing elastic search on windows 10
  • Refer Here
• Next Steps:
  • Configuring elastic search to run on linux systems on cloud

Learning parallelly

• Linux Classroom Recorded Sessions on Youtube Refer Here
• Creating a linux ec2 instance (vm) on AWS Refer Here
• Creating a linux vm in Azure Refer Here