Our client was developing a new project based on a microservices architecture. Microservices are distributed on various machines, and they are easy to scale. This lead to the need for centralized logging (logs from all services are gathered in a centralized storage, and searches can be performed on all the available data).
As part of this project, we designed and implemented an Elasticsearch cluster, based on the business needs and volume of data of our client. Benchmarks, sizing, disaster recovery and planning for future growth (as more applications send logs to this cluster) are part of the challenges we faced over time and succeeded in bringing viable and scalable solutions for.