RousselTMLEARNING

Article · Kibana and Elastic Observability: from discovery to expertise

Elastic Observability

1. Overview #

A solution built into Kibana.

The applications #

Elastic Observability
All data lands in data streams named according to a convention (type-dataset-namespace).
ApplicationUsage
Logs (Discover, Logs Explorer)Log search and analysis, automatic categorization
InfrastructureInventory of hosts, containers and pods with their metrics
APMServices, transactions, errors, traces and service map
Synthetics / UptimeScheduled tests (HTTP, browser) and availability
SLOService objectives and error budgets
AI AssistantAnalysis help (depending on license and configuration)

2. Elastic Agent and Fleet #

A single, centrally managed agent.

Principle #

Elastic Agent replaces the various Beats with a single agent. It is managed from Kibana by Fleet: you define policies made of integrations (System, Nginx, PostgreSQL, Kubernetes...), and agents apply them automatically.

# Commande fournie par Kibana (Fleet > Add agent), de la forme :
sudo ./elastic-agent install --url=https://fleet.example.org:8220 --enrollment-token=<jeton>

Each integration creates its data streams (for example logs-nginx.access-default, metrics-system.cpu-default), its ingest pipelines and ready-to-use dashboards.

Good practice: The type-dataset-namespace convention lets you set permissions and retention per namespace (for example production and staging).

3. APM and OpenTelemetry #

Traces and application performance.

Instrumenting #

Elastic APM accepts the historical Elastic agents (Java, .NET, Node.js, Python, Go, PHP, Ruby) and OpenTelemetry. Elastic publishes its own OpenTelemetry distributions (EDOT) and now recommends this path.

# Exemple : application Java avec l'agent OpenTelemetry vers Elastic (OTLP)
export OTEL_SERVICE_NAME=checkout
export OTEL_EXPORTER_OTLP_ENDPOINT=https://apm.example.org
export OTEL_EXPORTER_OTLP_HEADERS="Authorization=ApiKey <cle>"
export OTEL_RESOURCE_ATTRIBUTES=deployment.environment=production
java -javaagent:opentelemetry-javaagent.jar -jar checkout.jar

The APM application shows, per service, throughput, latency, error rate, the slowest transactions, traces and the service map built from observed calls.

Synthetics #

// journeys/panier.journey.ts (projet Synthetics, Playwright)
import { journey, step, expect } from '@elastic/synthetics';
journey('Ajout au panier', ({ page }) => {
  step('Accueil', async () => { await page.goto('https://boutique.example.org'); });
  step('Ajouter', async () => {
    await page.click('text=Ajouter au panier');
    expect(await page.isVisible('text=1 article')).toBeTruthy();
  });
});

📄 Elastic Observability: logs, infrastructure, APM and synthetics →

My progress

  • ⏱ Estimated time : ≈ 5 min

Sign in to track your progress and take notes. Sign in

💬 Questions about this lesson

No questions yet: be the first to ask for help or share your configuration.

Ask a question about this lesson →

Recommended Articles

Standalone Elastic Agent, Logstash and Kafka outputs, and OpenTelemetry (EDOT)

Write a standalone configuration, ship to Logstash or Kafka, and use Elastic Agent as an OpenTele...

Elastic path project: centralising and using logs

The validation project of the "Elastic Stack mastery" path: Elastic Agent and Fleet, Logstash, El...

OpenTelemetry traces in Elasticsearch and Kibana APM

Instrument applications with OpenTelemetry or EDOT SDKs, send traces to Elasticsearch, get Kibana...

Alerts, connectors and SLOs in Kibana

Create alert rules in Kibana (Elasticsearch query, ES|QL, custom threshold, logs), configure conn...

Ingesting OpenTelemetry logs into Elasticsearch

Collect and structure logs with the OpenTelemetry Collector (filelog receiver, operators, transfo...

Datadog: the SaaS observability platform at a glance

What Datadog is, its products (infrastructure, logs, APM, RUM, synthetics, security), its concept...

Kibana and Elastic Observability best practices

Checklist for running Kibana in production: versions, security, spaces and roles, versioned dashb...

Elastic Agent: architecture, Fleet and integrations

Understand Elastic Agent: single collection agent, Fleet and Fleet Server, agent policies, integr...

Beats: going further (security, performance, Elastic Agent and migrating to Alloy)

Industrialize Filebeat, Metricbeat and the other Beats: secure outputs, processors, modules, tuni...

Support us

♥ SUPPORT US

Support RousselTM Learning

Courses, articles, labs and certificates stay free with no intrusive ads. A voluntary contribution, of any amount you choose, pays for hosting, lab environments and new content.

Contribute with PayPal Any amount · card or PayPal accountLearn more
QR code PayPal
Or scan this QR code with your phone

Thank you, every contribution counts!