Building a REST API in Node.js with AWS Lambda, API Gateway, DynamoDB, and Serverless Framework

Originally posted at Serverless

Serverless means different things depending on the context. It could mean using third party managed services like Firebase, or it could mean an event-driven architecture style. It could mean next generation compute service offered by cloud providers, or it could mean a framework to build Serverless applications.

In this tutorial, you’ll learn how to build a REST API following the Serverless approach using AWS Lambda, API Gateway, DynamoDB, and the Serverless Framework. AWS Lambda is the third compute service from Amazon. It’s very different from the existing two compute services EC2 (Elastic Compute Cloud) and ECS (Elastic Container Service). AWS Lambda is an event-driven, serverless computing platform that executes your code in response to events. It manages the underlying infrastructure scaling it up or down to meet the event rate. You’re only charged for the time your code is executed. AWS Lambda currently supports Java, Python, and Node.js language runtimes.

This tutorial is part of my open-source hands-on guide to build real world Serverless applications by Shekhar Gulati, senior technologist at Xebia. You can refer to the guide for in-depth coverage on building Serverless applications.

Application: Lambda Coding Round Evaluator

In my current organization, one of the interview rounds is a coding round. The candidate is emailed an assignment that he/she has to submit in a week’s time. The assignment is then evaluated by an existing employee who makes the decision on whether the candidate passed or failed the round. I wanted to automate this process so that we can filter out unsuitable candidates without any human intervention. A task that can be automated should be automated. This is how the flow will work:

1. Recruitment team submits candidate details to the system.

2. System sends an email with assignment zip to the candidate based on candidate skills and experience. The zip contains the problem as well as a Gradle or Maven project.

3. Candidate writes the code and submits the assignment using Maven or Gradle task like gradle submitAssignment. The task zips the source code of the candidate and submits it to the system.

4. On receiving assignment, systems builds the project and run all test cases.

a. If the build fails, then candidate status is updated to failed in the system and recruitment team is notified.

b. If the build succeeds, then we find the test code coverage and if it’s less than a certain threshold we mark the candidate status to failed and recruitment team is notified.

1. If build succeeds and code coverage is above a certain threshold, then we run static analysis on the code to calculate the code quality score. If code quality score is below a specified threshold then candidate is marked failed and notification is sent to the recruitment team. Otherwise, the candidate passes the round and a human interviewer will now evaluate candidate assignment.

In this tutorial, we will only build a REST API to store candidate details. Please refer to the guide to learn how to build the full application from scratch. Also, source code for the application is available on Github.

Prerequisite

To go through this tutorial you will need following:

1. AWS account

2. Node.js

3. AWS CLI and configure it

What is the Serverless Framework?

The Serverless Framework makes it easy to build applications using AWS Lambda. It is multi-provider framework, which means you can use it to build Serverless applications using other providers as well. For AWS, Serverless relies on CloudFormation to do the provisioning. It also scaffolds the project structure and takes care of deploying functions.

Getting Started with the Serverless Framework

To install Serverless on your machine, run the below mentioned npm command.

This will install Serverless command-line on your machine. You can use sls alias instead of typing serverless as well.

Now, we will build the application in a step by step manner.

Step 1: Create a Node.js Serverless Project

Navigate to a convenient location on your filesystem and create a directory coding-round-evaluator.

Once inside the coding-round-evaluator directory, we'll scaffold our first microservice for working with candidates. This will be responsible for saving candidate details, listing candidates, and fetching a single candidate details.

This will create a directory candidate-service with the following structure.

Let’s look at each of these three files one by one.

1. .npmignore: This file is used to tell npm which files should be kept outside of the package.

2. handler.js: This declares your Lambda function. The created Lambda function returns a body with Go Serverless v1.0! Your function executed successfully! message.

3. serverless.yml: This file declares configuration that Serverless Framework uses to create your service. serverless.yml file has three sections — provider, functions, and resources.

a. provider: This section declares configuration specific to a cloud provider. You can use it to specify name of the cloud provider, region, runtime etc.

b. functions: This section is used to specify all the functions that your service is composed off. A service can be composed of one or more functions.

c. resources: This section declares all the resources that your functions use. Resources are declared using AWS CloudFormation.

Step 2: Create a REST Resource for Submitting Candidates

Next, we’ll update serverless.yml as shown below.

Let’s go over the YAML configuration:

1. We defined name of the service — candidate-service. Service name has to be unique for your account.

2. Next, we defined framework version range supported by this service.

3. Next, we defined configuration of the cloud provider. As we are using AWS so we defined AWS corresponding configuration.

4. Finally, we defined candidateSubmission function. In the configuration shown above, we declared that when the HTTP POST request is made to /candidates then api/candidate.submit handler should be invoked. We also specified memory we want to allocate to the function.

Now, create a new directory api inside the candidate-service directory. Move the handler.js to the api directory. Rename handler.js to candidate.js and rename handle to submit.

To deploy the function, execute serverless deploy command.

Now, POST operation of your service is available. You can use tools like cURL to make a POST request.

Step 3: Saving Data to DynamoDB

Now that we are able to make HTTP POST request to our API let’s update the code so that data can be saved to DynamoDB. We’ll start by adding iamRoleStatemements to serverless.yml. This defines which actions are permissible.

Next, we’ll create a resource that will create DynamoDB table as shown below.

Now, install a couple of node dependencies. These will be required by our code.

Update the api/candidate.js as shown below.

Now, you can deploy the function as shown below.

This will create the DynamoDB table.

To test the API, you can use cURL again.

The response you’ll receive from the API is shown below.

Step 4: Get All Candidates

Define a new function in the serverless.yml as shown below.

Create new function in the api/candidate.js as shown below.

Deploy the function again.

Once deployed you will be able to test the API using cURL.

Step 5: Get Candidate Details by ID

Define a new function in serverless.yml as shown below.

Define a new function in api/candidate.js

Now, you can test the API using cURL.

Working with Local DynamoDB

Download the jar and run locally.

Invoking Functions Locally and Remotely

Tailing the Logs

Conclusion

In this part, you learned how to create a REST API with the Serverless Framework. To learn more read the guide.