DEV Community

Cover image for Apache Log Parser and Data Normalization Application
Will Raymond
Will Raymond

Posted on • Edited on

Apache Log Parser and Data Normalization Application

#apache #python #mysql #parser

Python handles File Processing & MySQL handles Data Processing

ApacheLogs2MySQL consists of two Python Modules & one MySQL Schema to automate importing Access & Error files and normalizing data into database designed for reports & data analysis.

Runs on Windows, Linux and MacOS & tested with MySQL versions 8.0.39, 8.4.3, 9.0.0 & 9.1.0.

4 LogFormats & 2 ErrorLogFormats can be loaded and 5 MySQL Stored Procedures can be processed in a single Python ProcessLogs function execution.

Database system designed to accommodate unlimited Domains from unlimited Servers. Step-by-step guide for easy installation.

Web interface with Drill Down Capability and apache/echarts Log Visualization integration in development.

https://github.com/WillTheFarmer/apache-logs-to-mysql

Top comments (0)

profile
Docusign Developers
 Promoted

Image of Docusign

🛠️ Bring your solution into Docusign. Reach over 1.6M customers.

Docusign is now extensible. Overcome challenges with disconnected products and inaccessible data by bringing your solutions into Docusign and publishing to 1.6M customers in the App Center.

Learn more

Read next

shpetimhaxhiu profile image

Detailed Tutorial: Crawling GitHub Repository Folders Without API

Shpetim Haxhiu -

dm8ry profile image

How to Retrieve EC2 Instances Information Using Python and Boto3

Dmitry Romanoff -

blamsa0mine profile image

Interactive DataFrame Management with Streamlit Fragments 🚀

A0mineTV -

szabgab profile image

Python 🐍 and variable types

Gabor Szabo -