Cedi: Modern Observability - Scalable Observability with the LGTM Stack: Harnessing the Power of Lok

Discover the LGTM Stack, a scalable observability solution for modern engineering teams, featuring Loki for tracing, Prometheus for metrics, and more, to provide a complete picture of system behavior and enable effective debugging and monitoring.

Key takeaways
  • Cedi emphasizes the importance of observability in modern engineering teams, highlighting the need for a scalable and efficient solution.
  • Prometheus is presented as a scalable solution for metrics, with the remote write function allowing for efficient data collection.
  • Loki is introduced as a open-source solution for tracing, with the ability to record all paths taken from the beginning, making it a powerful tool for debugging.
  • The concept of lock aggregation is discussed, with the goal of automatically analyzing and displaying log data.
  • Metrics and tracing are highlighted as important pillars of observability, with the ability to answer different questions and provide a complete picture of system behavior.
  • The need for a scalable solution that can handle the growth of a system is emphasized, with MIMIA (Massively Intentsified Malice of Ingestion) being presented as a solution for scalable and cheap storage.
  • Structured logging is also discussed, with the goal of making log analysis easier and more efficient.
  • OpenTelemetry, Jaeger, and Tempo are mentioned as tools for tracing and monitoring.
  • The importance of a centralized place for observing data is highlighted, with Loki being presented as a solution for this.
  • The Grafana and Mimir tools are introduced, with the goal of providing a unified view of system behavior.
  • The limitations of Prometheus, such as its inability to handle long-term data retention, are mentioned as a reason to consider other solutions.
  • The need for easy-to-use, scalable, and efficient solutions is emphasized throughout the talk, with the goal of providing a complete picture of system behavior and enabling effective debugging and monitoring.