DEV Community

Discussion on: Watch out for Unexpected S3 cost when using Athena.

Collapse
 
jdonboch profile image
Jared Donboch • Edited

I just began consulting a company who wanted to investigate their growing S3 costs.

They had this exact problem which was exasperated by QuickSight which creates it's own S3 bucket for storing Athena query results and, depending on the SPICE caching configuration, can run large unfiltered Athena queries hourly to while it works on refreshing it's cache.

After a few years of storing those queries and cache refreshes, the bucket size was almost 20 TB, all in standard S3 storage.

Solution of adding a lifecycle policy to delete these transient files was easy and ended up saving almost $500 a month in a matter of minutes.