The latest articles on DEV Community by Will Raymond (@willthefarmer). https://dev.to/willthefarmer https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F2007960%2F0a8586f5-63f9-48e1-a998-97bb50a2303e.jpg https://dev.to/willthefarmer en Will Raymond Sun, 10 Nov 2024 14:52:21 +0000 https://dev.to/willthefarmer/apache-log-parser-and-data-normalization-farm-built-3ahl https://dev.to/willthefarmer/apache-log-parser-and-data-normalization-farm-built-3ahl <h3> Python handles File Processing &amp; MySQL handles Data Processing </h3> <p>ApacheLogs2MySQL consists of two Python Modules &amp; one MySQL Schema to automate importing Access &amp; Error files and normalizing data into database designed for reports &amp; data analysis.</p> <p>Runs on Windows, Linux and MacOS &amp; tested with MySQL versions 8.0.39, 8.4.3, 9.0.0 &amp; 9.1.0.</p> <p>4 LogFormats &amp; 2 ErrorLogFormats can be loaded and 5 MySQL Stored Procedures can be processed in a single Python <code>ProcessLogs function</code> execution.</p> <p>Database system designed to accommodate unlimited Domains from unlimited Servers. Step-by-step guide for easy installation.</p> <p>Web interface with Drill Down Capability and <a href="https://github.com/apache/echarts" rel="noopener noreferrer">apache/echarts</a> Log Visualization integration in development.</p> <p><a href="https://github.com/WillTheFarmer/apache-logs-to-mysql" rel="noopener noreferrer">https://github.com/WillTheFarmer/apache-logs-to-mysql</a></p> apache python mysql parser