Skip to content

feat: migrate m3 deprecated timers to histograms#640

Draft
thijmv wants to merge 1 commit into
masterfrom
thijmv/timer-deprecation
Draft

feat: migrate m3 deprecated timers to histograms#640
thijmv wants to merge 1 commit into
masterfrom
thijmv/timer-deprecation

Conversation

@thijmv

@thijmv thijmv commented Jun 29, 2026

Copy link
Copy Markdown
Collaborator

Summary

This PR migrates all timers used in Kraken to histograms, as timers are slowly being deprecated by M3. Timers not used in any dashboard panel or alert are dropped instead.

Metrics

The bucket ranges for the metrics are based on seven days of production data.

Metric Range Reason
lib/middleware:latency 1ms-8.7m (n=20) Tracker 50ms p95, proxy 500s p99.9, agent alert 2m/5m, proxy alert 10s/20s
origin/blobserver:replicate_blob 10ms-21.8m (n=18) Fast zones 50ms p50, regular 5-10m spikes, 21m outliers
proxy/proxyserver:blob_download_time 1ms-8.7m (n=20) 5ms p1, avg 0.4-1.7s p95, alert 2m/5m

The following metrics were dropped, as they were not used in any panel or alert:

  • tracker/trackerserver:get_metainfo
  • lib/persistedretry/tagreplication:replicate
  • lib/persistedretry/tagreplication:lifetime

Future work

  • Update queries for dashboard panels and alerts.
  • Validate appropriate histogram bucket distribution.

@thijmv thijmv marked this pull request as draft June 29, 2026 16:46
Comment thread agent/agentserver/server.go
Comment thread lib/middleware/middleware.go
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants