The latest articles on DEV Community by Naveen Ayalla (@naveenayalla1cs50). https://dev.to/naveenayalla1cs50 https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3961746%2Fa85c1ba3-c53c-484a-ad47-a9ab657d84b3.png https://dev.to/naveenayalla1cs50 en Naveen Ayalla Sun, 31 May 2026 23:10:33 +0000 https://dev.to/naveenayalla1cs50/building-a-pyspark-and-aws-glue-etl-pipeline-for-search-keyword-revenue-analysis-6gp https://dev.to/naveenayalla1cs50/building-a-pyspark-and-aws-glue-etl-pipeline-for-search-keyword-revenue-analysis-6gp <p>I published a public data engineering project that demonstrates a cloud-based ETL pipeline for analyzing web analytics search keyword revenue.</p> <p>The project uses PySpark, AWS Glue, Amazon S3, and Terraform to process hit-level web analytics data, extract external search engine domains and keywords, parse revenue, and generate a sorted reporting output.</p> <p>Key concepts covered:</p> <p>Batch ETL pipeline design<br> PySpark transformations<br> AWS Glue job configuration<br> S3 input and output workflow<br> Revenue aggregation logic<br> Terraform infrastructure examples</p> <p>This is a generic open-source portfolio project and does not include proprietary or company-provided data.</p> <p>GitHub: <a href="https://github.com/naveenayalla1-CS50/search-keyword-performance-revenue" rel="noopener noreferrer">https://github.com/naveenayalla1-CS50/search-keyword-performance-revenue</a></p> <p>Feedback from data engineers and cloud data practitioners is welcome.</p> aws dataengineering showdev terraform