Published November 30, 2023 | Version v1
Journal article Open

Observability in Microservices Architectures: Leveraging Logging, Metrics, and Distributed Tracing in Large-Scale Systems

Authors/Creators

Description

Built upon microservices architecture (MSA) and thanks to its off-regions growth nature, it has become a big rage for creating scalable distributed systems. However, managing these systems brings its own challenges, especially when it comes to monitoring and debugging performance. You could go a long way in growing and scaling a system without knowing internal states and interactions but having proper levels of observability (logging, metrics, distributed tracing) within microservices-based systems. The present paper also discusses the observability of microservices and how those services can ensure their system is in a stable condition by utilizing some tools such as Prometheus, Grafana, and Jaeger. This post discusses how these tools add value in monitoring system health and making operationally meaningful decisions in large-scale environments. This article explores key challenges like data overload and instrumentation complexity in achieving better observability with microservices architectures, followed by best practices to improve the same.

Files

EJAET-10-12-24-31.pdf

Files (245.1 kB)

Name Size Download all
md5:4b240ea02457c666e9f0125118cb41d7
245.1 kB Preview Download

Additional details

References

  • [1]. M. Usman, S. Ferlin, A. Brunstrom, and J. Taheri, "A Survey on Observability of Distributed Edge & Container-based Microservices," IEEE Access, pp. 1–1, 2022, doi: https://doi.org/10.1109/access.2022.3193102
  • [2]. F. Khan, "Microservices Metrics Visualization," Urn.fi, Nov. 2020, doi: https://trepo.tuni.fi/handle/10024/123949.
  • [3]. D. M. Mengistu, "Distributed Microservice Tracing Systems: Open-source tracing implementation for distributed Microservices built in Spring framework," Urn.fi, 2020, doi: http://www.theseus.fi/handle/10024/340267.
  • [4]. B. Li et al., "Enjoy your observability: an industrial survey of microservice tracing and analysis," Empirical Software Engineering, vol. 27, no. 1, Nov. 2021, doi: https://doi.org/10.1007/s10664-021-10063-9.
  • [5]. P. Ribeiro, "Reactive Microservices - An Experiment," Handle.net, 2022, doi: http://hdl.handle.net/10400.22/20831.
  • [6]. N. Kratzke, "Cloud-Native Observability: The Many-Faceted Benefits of Structured and Unified Logging—A Multi-Case Study," Future Internet, vol. 14, no. 10, p. 274, Sep. 2022, doi: https://doi.org/10.3390/fi14100274.
  • [7]. M. Frisell, "Information visualization of microservice architecture relations and system monitoring: A case study on the microservices of a digital rights management company - an observability perspective," Dissertation, 2018.