DevOps Classroom Series – 24/Nov/2020

Scenario of Organization: Learning Thoughts

• Learning Thoughts is provider of Point Of Sale Systems. (LT-POS)
• Customers of LT-POS
  • Use Point of Sale System from different Branches
  • They have BI module for sales forecasting, reporting etc
• In the case of any application failures, LT has a support team who will look into issues
• When something fails how will support team look into issues
  • failure at POS
  • failure at Server
  • failure at BI
• Support team needs to have access to logs/events generated by system to resolve failures.
• LT-POS system was not developed by one team, it is series of takeovers. Problem here is each component has a different log formats and log destinations
  • files
  • databases
  • external system
• We need to help LT-POS to have one effecient log monitoring solution (centralized log monitoring) which can read different log formats from different log sources.
• Logs are generally text and querying the text is difficult.
• LT-POS needs a log monitoring system which is very good at text searching.
• There are many alternatives
  • Splunk
  • Elastic Stack
  • DataDog
• LT wants to use an Open Source System which is cost effective, So Elastic Stack is the clear winner here.

Elastic Stack

• This is rich ecosystem of components serving as a full search & analytics stack.
• The main components of Elastic Stack are
  • Elastic Search: database of Elastic Stack, provides storage, search and analytics capabilities
  • Logstash: helps in storing the data into Elastic Search
  • Beats: helps in storing the data into Elastic Search
  • Kibana: UI/Window of Elastic Stack. This provides visualization capabilities
  • X-Pack: provides features including monitoring, alerting & machine learning to make your system production-ready
• So lets see how can we integrate elastic stack to LT-POS so that log searching and analytics capabilities can be added

Workflow of Elastic Stack

Exercise:

1. You need a cloud account
   1. AWS Refer Here
   2. Azure Refer Here
2. Create one vm and delete that VM
   1. AWS Refer Here
   2. Azure Refer Here
3. Softwares to be installed on your system Refer Here
4. Install Windows Terminal Refer Here