Visualizing Pi-hole Logs with Elasticsearch, Logstash, and Kibana.
This guide will walk you through visualizing Pihole logs with Elasticsearch, Logstash, and Kibana.…
Video Tutorial: Streaming From Elasticsearch to Syslog via Apache NiFi
This guide will walk through the process of pulling data from Elastic, extracting out key fields, and exporting it as syslog events in near real-time.…
Recombining Multiline Logs into JSON With Apache NiFi
This guide will show you how to use Apache NiFi to stitch multiline logs into single and coherent events in JSON format.…
Apache NiFi, Microsoft SQL Server, and Kerberos Authentication
The purpose of this tutorial is to configure Apache NiFI to use Kerberos authentication against a Microsoft SQL Server, query the database, convert the output to JSON, and output that data in syslog format. NiFi is capable of doing all of this with minimal configuration.…
Apache NiFi: NetFlow to Syslog
Most organizations have flows enabled at some level. This data can be used for anything from troubleshooting to statistics to security. There are many types of flow formats available, e.g. NetFlow, sFlow, IPFIX, etc. For this example, we’ll be using Apache NiFi to ingest NetFlow v5 and output…
Apache NiFi: SFTP/CSV to Syslog/JSON
A common problem in log management is the ability to fetch remote files, get them into some type of manageable structure, and output them into another platform. The remote file could encompass anything: data from HR, a dump from a database, or a CSV of application information. In this case,…
Apache Nifi: Pulling From MySQL and Sending to Syslog
My last post [https://nathanlabadie.com/apache-nifi-syslog-load-balancing/] covered the bare-bones basics of using Apache Nifi to load-balance incoming syslog events. In this example we’re going to take it a step further: query a MySQL database containing entity events from Home Assistant [https://www.home-assistant.io/], reformat the output to…
Apache NiFi: Syslog Load Balancing
Simple syslog load-balancing with Apache NiFi.…