[TP] My second pipeline
What you will learn in this TP :
Prerequisites
You must have done the lab 'My first pipeline'Inputs configuration
You must create a file in /etc/logstash/conf.d named "0-input-file-advanced.conf".-
Reading a file
In this file, you must add the logstash configuration to read the contents of all log files starting with: "/var/log/rousseltm/advanced-".You must add a type for this file with the value 'advanced'.
Filters configuration
You must create a second file named "101-filter-advances.conf".-
Data extraction
You must identify the most suitable filter for a flat file and put the configuration that will extract the fields from the previously read log files knowing that these files are made up of several log formats. -
Type modification
We want to convert the "HTTP_CODE" field to an integer. Indeed, there are often arithmetic operations on this field when making restitutions (dashboard, alerts...). For example, display all codes between 200 and 205. -
Field deletion
We will remove the message field as we have already extracted the information that interests us.
Outputs configuration
You must modify the file "200-output-file-nginx-access".-
Writing to a file
In this file, you must update the logstash configuration so that it writes the logs to the file that corresponds to its 'type'
Recommended Articles
Understand the evolution of billing in Dynatrace: the difference between the ...
Discover why and how to configure Grafana Alloy so that it monitors itself, c...
Discover how to enable, secure, and use Grafana Alloy's built-in web interfac...
Discover the fundamental concepts of Grafana Alloy, the transition from the s...
Master Grafana Alloy's declarative syntax (River language), learn to manipula...
Learn how to configure Grafana Alloy to collect, transform, and forward metri...
Discover how to configure Grafana Alloy to read log files, journald, or netwo...
Dive into distributed trace processing. Learn how to ingest OTLP, Jaeger, or ...
Discover how to configure continuous profiling in your environments using Gra...
Learn how to manage large-scale Grafana Alloy deployments. Configure Clusteri...
Discover Grafana Assistant, the artificial intelligence integrated into Grafa...
Comparison between Grafana Alloy and Dynatrace ActiveGate. Understand the fun...