DEV Community

Cover image for Streaming data into Kafka S01/E04 — Parsing log files using Grok Expressions

Streaming data into Kafka S01/E04 — Parsing log files using Grok Expressions

Florian Hussonnois on January 05, 2021

This is the fourth and last article of the series "Streaming data into Kafka" series. In the first three articles, we saw how it's fairly easy to u...
Collapse
 
nybblehub profile image
Nybble

Hi Florian,

Really cool feature ! I have one question, is it possible to add a k/v during the parsing process or this need to be done after, separately ?

Thanks !

Collapse
 
fhussonnois profile image
Florian Hussonnois

Hi,

If your need is to add a simple K/V field this can be done using the AppendFilter provided by FilePulse. FilePulse allows you to chain multiple processing filters similar to SMTs.

I hope I've answered to your question