- The Amazon S3 notification feature is able to receive notifications when certain events happen in the bucket.
- To enable notifications, it must first adds a notification configuration that identifies the events which want Amazon S3 to publish and the destinations where to send the notifications here is lambda function
- Overview of notifications
- This post describe how to use AWS chalice to create this.
1. Create aws chalice new-project cdn-invalidation
⚡ $ chalice new-project cdn-invalidation
⚡ $ ls cdn-invalidation
app.py requirements.txt
2. Define which region to create lambda function instead of the default in local aws configuration
⚡ $ export AWS_DEFAULT_REGION=us-east-1
3. Create lamdba function handler
- The handler listen to
s3:ObjectCreated:Put
event so any changes in s3://mybucket/static/src will trigger the lambda function app.py
from chalice import Chalice
import boto3
import time
app_name = 'cdn-invalidation'
app = Chalice(app_name=app_name)
app.debug = True
class InvalidateCDN:
""" Invalidate CDN """
def __init__(self):
self.distribution_id = 'A1AA1AA11A11AA'
self.client = boto3.client('cloudfront')
def create_invalidation(self, file_change):
try:
res = self.client.create_invalidation(
DistributionId=self.distribution_id,
InvalidationBatch={
'Paths': {
'Quantity': 1,
'Items': ["/{}".format(file_change)]
},
'CallerReference': str(time.time()).replace(".", "")
}
)
invalidation_id = res['Invalidation']['Id']
return invalidation_id
except Exception as err:
print(f"Failed to create invalidation, error {err}")
exit(1)
def get_invalidation_status(self, inval_id):
try:
res = self.client.get_invalidation(
DistributionId=self.distribution_id,
Id=inval_id
)
return res['Invalidation']['Status']
except Exception as err:
print(f"Failed to get invalidation status ID {inval_id}, error {err}")
exit(1)
def run(self, key):
print(f"Deploying CDN file: {key}")
the_id = self.create_invalidation(key)
count = 0
while True:
status = self.get_invalidation_status(the_id)
if status == 'Completed':
print(f"Completed, id: {the_id}")
break
elif count < 10:
count += 1
time.sleep(30)
else:
print("Timeout, please check CDN")
break
@app.on_s3_event(bucket='mybucket',
prefix='static/src/',
events=['s3:ObjectCreated:Put'])
def handle_s3_event(event):
cdn = InvalidateCDN()
cdn.run(event.key)
4. Updaterequirements.txt
to include boto3 in lambda fuction
⚡ $ cat requirements.txt
boto3
5. Deploy
⚡ $ chalice deploy
Ref: https://github.com/vumdao/cicd-invalidation-cdn/tree/master/cdn-invalidation
Top comments (7)
Is there a way to do this using chalice with CDK integration? when I try deploying using cdk deploy command I get the following error:
Unable to package chalice apps that @app.on_s3_event decorator. CloudFormation does not support modifying the event notifications of existing buckets. You can deploy this app using
chalice deploy
.Unfortunately I migrated all my chalice projects to fully CDK :)
With current version , we can not use
on_s3_event
withcdk deploy
. The only option i think iss3 event -> sqs/sns -> chalice.on_sqs_message
. There is one cons is that we need to filter the prefix/suffix by ourself in on_sqs_message handler .I assume you follow the cdk deploy tutorial
This is example chalice stack infrastructure/stacks/chaliceapp.py
Then in your
runtime/app.py
, you can receive the sqs message :And after deployment, upload a file to s3 then in
cloudwatch
, there would be something like thisI need help... I have this scrapper that gets data from a website, please how do I use lambda function with EventBridge to trigger the scrapper to get data on a daily basis.
Use EventBridge with cron schedule to trigger lambda function
thanks
thanks for sharing