1. The chain #
Where to act.
Steps #
| Element | Role | Advice |
|---|---|---|
| Detector, metric event | Turns a metric into an event (static, adaptive, seasonal threshold) | A sliding window (3 out of 5 minutes) rather than a single point |
| Davis event | Event sent through the API or extracted from a log | Use event types for severity |
| Alerting profile | Filters notified problems: severity, duration, tags, zone | One profile per team and per on-call level |
| Integration or workflow | Sends to email, Slack, Teams, PagerDuty, ServiceNow | Workflows for complex rules |
| Maintenance window | Suspends detection or notification | Scheduled with each production release |
2. Reducing noise #
Fewer, more useful alerts.
Rules #
- Let Davis group: alert on problems, not on every event.
- Delay before notification in the profile (for example 10 minutes for low severities): many problems resolve themselves.
- Team tags set at the source to route without a manually maintained entity list.
- Monthly review of problems notified without any human action: they are candidates for removal.
Common mistake: An alerting profile without a severity filter sends minor slowdowns of every application to on-call: alert fatigue then causes the real incident to be missed.
My progress
Sign in to track your progress and take notes. Sign in
💬 Recent discussions about this course
- Dynatrace : mes pods Kubernetes ne sont pas instrumentés malgré le DynaKube✓ solved · 1 reply(ies)
Ask a question about this lesson →See all discussions about this course
Course Glossary
AIOps (Artificial Intelligence for IT Operations)
The use of artificial intelligence and machine learning to automate and improve IT operations (e.g., anomaly detection, reducing alert noise).
OpenTelemetry
An open source framework providing standards, APIs, and SDKs to collect and export observability data (traces, metrics, logs) in an agnostic way.
Core Web Vitals
Set of three metrics defined by Google to measure the real experience of a web page: loading (LCP (Largest Contentful Paint)), responsiveness (INP (In...
LCP (Largest Contentful Paint)
Time until the largest visible element of the page (image, video or text block) is rendered: it shows when the main content appears. Loading metric of...
INP (Interaction to Next Paint)
Latency of interactions (click, tap, key press) observed over the whole visit: the delay between the user's action and the next paint. The reported va...
CLS (Cumulative Layout Shift)
Measure of visual stability: the sum of unexpected layout shifts (a button moving just as you click, text pushed down by an ad). Unitless, computed ov...
FCP (First Contentful Paint)
Time until the first content (text, image, SVG) is rendered: the moment the user sees the page start loading. It is not a Core Web Vital, but it helps...
TTFB (Time to First Byte)
Time between the start of navigation and the arrival of the first byte of the response: it adds up redirects, DNS, TCP/TLS connection and server proce...
FID (First Input Delay)
Former responsiveness metric of the Core Web Vitals: the delay before the browser starts handling the first interaction (good ≤ 100 ms). It ignored la...
TBT (Total Blocking Time)
Lab metric (Lighthouse): the sum, between FCP (First Contentful Paint) and the end of loading, of the blocking part of each long task (over 50 ms) on ...
CrUX (Chrome UX Report)
Google's public dataset aggregating the Core Web Vitals measured from real Chrome users (at the 75th percentile, per origin and URL, over a rolling 28...
Lighthouse
Google's free audit tool, built into Chrome DevTools and PageSpeed Insights: it loads the page in a simulated environment and scores performance, acce...
Apdex
Application Performance Index: a satisfaction score between 0 and 1 based on a time threshold T. Requests under T are “satisfied”, between T and 4T “t...
Recommended Articles
Problem management in Dynatrace: Davis, the problem page, notifications and auto-remediation
Understand the problems detected by Davis, read a problem page (root cause, impact, timeline), co...
Advanced Davis AI: anomaly detection, causal, predictive and generative AI
Understand Davis AI: static thresholds, auto-adaptive and seasonal baselines, causal analysis and...
Advanced logs with OpenPipeline: processing, masking, buckets and retention
Manage logs in Dynatrace with OpenPipeline: ingestion, routing, DQL processing (parsing, enrichme...
Dynatrace best practices guide: towards mature observability
Optimize your Dynatrace platform with our expert recommendations: automated tagging, segmentation...
Advanced Grail and DQL: performance, parse, joins, time series, entities and correlation
Writing fast, low-cost DQL queries, parsing text with DPL and JSON, combining sources with lookup...
Using the Dynatrace API v2: a complete guide to automation
Learn how to use the Dynatrace API to automate your observability: managing scopes, routing throu...
Dynatrace: definitions, architecture and Davis artificial intelligence
The basic concepts of Dynatrace (entities, Smartscape, PurePath, Davis) and its architecture: One...
Dynatrace security and governance: advanced IAM, policies, SSO, audit and data protection
Secure and govern Dynatrace: SSO and SCIM, groups, IAM policies with conditions, security context...
Alerting on error budget burn rate (multi-window burn rate)
Why alert on burn rate rather than a threshold, and how to build the multi-window, multi-burn-rat...