Skip to content

feat(grafana): alert on stale Dingo chain tips - #83

Open
wolf31o2 wants to merge 1 commit into
mainfrom
fix/dingo-stale-chain-alert
Open

wolf31o2 wants to merge 1 commit into
mainfrom
fix/dingo-stale-chain-alert

Conversation

@wolf31o2

Copy link
Copy Markdown
Contributor

Dingo can continue serving successful API responses while chain selection is stalled. Add a per-pod alert when dingo_tip_gap_slots remains above 1,000 for 10 minutes, covering API nodes, relays, and producers scraped in the dingo namespace. The delay allows transient lag and uses the native readiness tolerance. Initial Mithril imports without this metric do not trigger the rule.

Validation: JSON parsing and git diff checks passed. Live fleet inspection identified Preview API as stale while other serving Dingo nodes were within 40 slots of tip. This PR prepares the alert; it has not been applied to Grafana.

Signed-off-by: Chris Gianelloni <wolf31o2@blinklabs.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant