RousselTMLEARNING

TP · Logstash: from discovery to expertise

Setting up the test environment

Oracle VM VirtualBox #

We will use VirtualBox to deploy our test VMs. Some labs will be done on Docker so if you already have a Docker engine you can use it instead of deploying a new VM.

You must proceed with the installation of VirtualBox by following the procedure corresponding to your system:

https://www.virtualbox.org/wiki/Downloads

Hashicorp Vagrant #

We will use Vagrant to automatically deploy test environments. To learn more about Vagrant, you can follow our dedicated training.

You must proceed with the installation of Vagrant by following the procedure corresponding to your system:

https://developer.hashicorp.com/vagrant/install

From concept to expertise #

We have preconfigured a repo for the training.

  1. Git repo

    You can use the command below to clone the repo:

    git clone https://github.com/RousselTM/logstash-formation
  2. Environment choice

    The test environment configurations are located in the tp folder. In this folder there are several subfolders, each corresponding to a test environment: simple VM, VM with Docker, VM with application... Depending on the lab, we will specify which one to use:

    cd logstash-formation/tp/REP
  3. Creation of the environment

    Once in the folder that corresponds to the desired environment, you can launch the creation of the environment on VirtualBox with the following Vagrant command

    vagrant up

Difficulty level : ●○○○○ (1/5)

My progress

  • ⏱ Estimated time : ≈ 21 min

Sign in to track your progress and take notes. Sign in

💬 Ask a question

Course Glossary

Logstash

An open-source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to...

Recommended Articles

Bonnes pratiques Logstash : pipelines, performances, fiabilité et supervision

Bonnes pratiques Logstash : pipelines multiples, dissect plutôt que grok, conditionnels, persiste...

Transformer avec VRL et tester ses pipelines Vector

Le langage VRL (Vector Remap Language) : analyse de logs (JSON, regex, syslog), gestion des erreu...

Understanding the Elastic Common Schema (ECS)

As always in our consulting engagements, we recommend that companies harmonise and standardise: k...

Fluent Bit : les inputs (entrées) du pipeline en détail

Tout sur les inputs de Fluent Bit : rôle des tags, lecture de fichiers avec tail (positions, rota...

Fluent Bit : parsers et filters, structurer et transformer les logs

Structurer et transformer les logs dans Fluent Bit : parsers (json, regex, logfmt, ltsv), parsers...

Fluent Bit : les outputs (sorties), routage et fiabilité de l'envoi

Envoyer les données de Fluent Bit : routage par Match et Match_Regex, sorties Loki, Elasticsearch...

Ingestion Elasticsearch : Bulk API, ingest pipelines, enrich et reindex

Ingérer et transformer des données dans Elasticsearch : Bulk API, ingest pipelines et processeurs...

Query DSL et agrégations avancées Elasticsearch, avec ES|QL

Écrire des requêtes Elasticsearch avancées : bool, filter et score, nested, function_score et per...

Collecteurs de logs légers : Fluent Bit, Vector et les autres

Pourquoi un collecteur de logs, ce qui distingue les agents légers (Fluent Bit, Vector) des colle...

Support us

♥ SUPPORT US

Support RousselTM Learning

Courses, articles, labs and certificates stay free with no intrusive ads. A voluntary contribution, of any amount you choose, pays for hosting, lab environments and new content.

Contribute with PayPal Any amount · card or PayPal accountLearn more
QR code PayPal
Or scan this QR code with your phone

Thank you, every contribution counts!