Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Chain filters in logstash

Is it possible to use logstash filters in sequence? For example I want to parse message into json then newly created field split by character.

input => filter => filter => output => elasticsearch

like image 791
Marcin Avatar asked Nov 27 '15 14:11

Marcin


People also ask

What are filters in Logstash?

The filters of Logstash measures manipulate and create events like Apache-Access. Many filter plugins used to manage the events in Logstash. Here, in an example of the Logstash Aggregate Filter, we are filtering the duration every SQL transaction in a database and computing the total time.

What is mutate in Logstash?

The Logstash mutate is defined as the mutate is the filter in logstash. It can allow us to accomplish general mutations on fields like it can rename, remove, replace, and modify the fields in our events. We can say that the filters in the logstash will allow us to constrain the fields into a particular type of data.

What is mutate filter?

The mutate filter allows you to perform general mutations on fields. You can rename, replace, and modify fields in your events.

What is a Logstash pipeline?

Introduction to Logstash Pipeline The logstash is an open-source data processing pipeline in which it can able to consume one or more inputs from the event and it can able to modify, and after that, it can convey with every event from a single output to the added outputs.


2 Answers

Yes, it's mentioned in the official doc.

If you specify multiple filters, they are applied in the order of their appearance in the configuration file.

like image 56
yyk Avatar answered Oct 30 '22 03:10

yyk


Yes. In filter conf file keep "field split by character" filter below the "json parsor" filter.

like image 38
jijinp Avatar answered Oct 30 '22 04:10

jijinp