DEV Community

Deploy the Generative AI Application Builder on AWS

This solution is based on the below architecture with pure serverless technology on AWS.

The overview of this diagram is described as follows:

  1. Use CloudFront to deliver the Web GUI which is hosted on S3 bucket.
  2. The Web GUI leverages the REST API which behind APIGateway.
  3. Use AWSWAF to protect the API from attacks via web ACL.
  4. Leverage Cognito to authenticate users against Web UI and API Gateway.
  5. AWS Lambda hosts the business logic for the Rest API.
  6. Use CloudFormation to deploy the Use Cases.
  7. Amazon DynamoDB stores the data of deployments.
  8. Amazon CloudWatch monitors the performance of solution and operational health.

Deployment Process:

  1. Download the cloudformation template from here

  2. Deploy the downloaded template with inputs to the following parameters on AWS cloudformation console

  • Admin User Email: your email address

  • DeployUI: Yes

After the deployment is completed, you can get access to the Web UI as shown below

Deploy a Use Case such as Text based chatbot

Now you can start to chat with your LLM such as Amazon Nova Pro

Top comments (0)