Distributed Tracing — we’ve been doing it wrong

The Many Faces of Tracing

The Problem with the Traceview

Spans are too low level

Alternatives to the traceview

Service-Centric Views

  1. latency distribution graphs of only the outlier requests
  2. latency distribution graphs when the service’s SLOs aren’t met
  3. most “common”, “interesting” or “weird” tags in requests that are being most frequently retried
  4. latency breakdowns when the service’s dependencies aren’t meeting their SLO
  5. latency breakdown by different downstream services

Service Topology Graphs

A hypothetical service view graph of a newspaper front page.
A dynamic service topology graph, showing me only the “interesting” services.

Comparison Views

Conclusion

--

--

--

@copyconstruct on Twitter. views expressed on this blog are solely mine, not those of present or past employers.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Application Frameworks

Some tools that we are going to cover in this module

10 DockerCon 2020 Talks for 5/28

Installing Anaconda for Windows 10/8/7

You Just Need to Speculate to Exfiltrate

Thunder Client (vscode extension)— Pengganti POSTMAN

Building a Go Web API with the Digital Ocean App Platform

Serverless Services in AWS

GCP | Dynamic GLB Backend Service with “dynamic” block using Terraform

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Cindy Sridharan

Cindy Sridharan

@copyconstruct on Twitter. views expressed on this blog are solely mine, not those of present or past employers.

More from Medium

Chaos Engineering at Expedia Group

Many Lego blocks of different sizes, shapes, and colors

How we aligned 200 teams to monitor services with SLOs (2/2)

Klarna stickered laptop

99% to 99.9% SLO: High Performance Kubernetes Control Plane at Pinterest

Distributed Tracing with Hypertrace