DEV Community 👩‍💻👨‍💻

Cover image for Create AWS Lambda Function Triggered By S3 Notification Event
🚀  Vu Dao 🚀
🚀 Vu Dao 🚀

Posted on

Create AWS Lambda Function Triggered By S3 Notification Event

  • The Amazon S3 notification feature is able to receive notifications when certain events happen in the bucket.
  • To enable notifications, it must first adds a notification configuration that identifies the events which want Amazon S3 to publish and the destinations where to send the notifications here is lambda function
  • Overview of notifications
  • This post describe how to use AWS chalice to create this.

Alt Text

1. Create aws chalice new-project cdn-invalidation

⚡ $ chalice new-project cdn-invalidation
⚡ $ ls cdn-invalidation
app.py  requirements.txt
Enter fullscreen mode Exit fullscreen mode

2. Define which region to create lambda function instead of the default in local aws configuration

⚡ $ export AWS_DEFAULT_REGION=us-east-1
Enter fullscreen mode Exit fullscreen mode

3. Create lamdba function handler

  • The handler listen to s3:ObjectCreated:Put event so any changes in s3://mybucket/static/src will trigger the lambda function app.py Alt Text
from chalice import Chalice
import boto3
import time


app_name = 'cdn-invalidation'
app = Chalice(app_name=app_name)
app.debug = True


class InvalidateCDN:
    """ Invalidate CDN """
    def __init__(self):
        self.distribution_id = 'A1AA1AA11A11AA'
        self.client = boto3.client('cloudfront')

    def create_invalidation(self, file_change):
        try:
            res = self.client.create_invalidation(
                DistributionId=self.distribution_id,
                InvalidationBatch={
                    'Paths': {
                        'Quantity': 1,
                        'Items': ["/{}".format(file_change)]
                    },
                    'CallerReference': str(time.time()).replace(".", "")
                }
            )
            invalidation_id = res['Invalidation']['Id']
            return invalidation_id
        except Exception as err:
            print(f"Failed to create invalidation, error {err}")
            exit(1)

    def get_invalidation_status(self, inval_id):
        try:
            res = self.client.get_invalidation(
                DistributionId=self.distribution_id,
                Id=inval_id
            )
            return res['Invalidation']['Status']
        except Exception as err:
            print(f"Failed to get invalidation status ID {inval_id}, error {err}")
            exit(1)

    def run(self, key):
        print(f"Deploying CDN file: {key}")
        the_id = self.create_invalidation(key)
        count = 0
        while True:
            status = self.get_invalidation_status(the_id)
            if status == 'Completed':
                print(f"Completed, id: {the_id}")
                break
            elif count < 10:
                count += 1
                time.sleep(30)
            else:
                print("Timeout, please check CDN")
                break


@app.on_s3_event(bucket='mybucket',
                 prefix='static/src/',
                 events=['s3:ObjectCreated:Put'])
def handle_s3_event(event):
    cdn = InvalidateCDN()
    cdn.run(event.key)
Enter fullscreen mode Exit fullscreen mode

4. Updaterequirements.txt to include boto3 in lambda fuction

⚡ $ cat requirements.txt
boto3
Enter fullscreen mode Exit fullscreen mode

5. Deploy

⚡ $ chalice deploy
Enter fullscreen mode Exit fullscreen mode

Alt Text

Alt Text

Ref: https://github.com/vumdao/cicd-invalidation-cdn/tree/master/cdn-invalidation

Top comments (6)

Collapse
samzoozi profile image
Ali Zonoozi

Is there a way to do this using chalice with CDK integration? when I try deploying using cdk deploy command I get the following error:

Unable to package chalice apps that @app.on_s3_event decorator. CloudFormation does not support modifying the event notifications of existing buckets. You can deploy this app using chalice deploy.

Collapse
vumdao profile image
🚀 Vu Dao 🚀 Author

Unfortunately I migrated all my chalice projects to fully CDK :)

Collapse
sillians profile image
Basil Ihuoma

I need help... I have this scrapper that gets data from a website, please how do I use lambda function with EventBridge to trigger the scrapper to get data on a daily basis.

Collapse
vumdao profile image
🚀 Vu Dao 🚀 Author

Use EventBridge with cron schedule to trigger lambda function

Collapse
sillians profile image
Basil Ihuoma

thanks

Collapse
routinggames profile image
Duy Nguy3n

thanks for sharing

🌚 Browsing with dark mode makes you a better developer.

It's a scientific fact.