Introduction
Previous tutorial: Setting up Cowrie and Dionaea
A visualization tool, in terms of logs, is designed to process imported logs and present the data in a more structured manner, allowing a manager to easily create a visual representation of the logs. These visual representations can come in the range of tables to graphs.
The Elastic stack is a stack of three software components (Elastic Search, Logstash and Kibana) from the same developer, Elastic. They are designed to work together in order to make up a complete log handling and visualization tool. They are also free to use, with the exception of hosting services and premium features.
In this tutorial we will be using the Elastic stack to set up a centralized log server that can monitor malicious activities in real time. We will also configure both Cowrie and Dionaea so that Kibana can be used to create visual representations from events such as downloads and command inputs.
Our goal
Our goal in this tutorial is to set up a centralized log server that can receive logs from the Cowrie- and Dionaea -honeypots, which can process and create a database out of the log entries. This database will be used by Kibana to set up visual representations of the logs, such as tables and graphs.
This setup consists of the following four software components:
- Logstash: A service that will receive logs from Cowrie and Dionaea, processes them depending on given configurations and then give the output directly to Elastic Search.
- Elastic Search: A database which will store and index the results received from Logstash.
- Kibana: A management GUI for visual representations that will query Elastic Search in order to provide data to the configured visual representations.
- Filebeat: A software installed on the honeypot that will monitor the logs from Cowrie and Dionaea, and then send (beat) any new entry to Logstash.