This solution is based on the below architecture with pure serverless technology on AWS.
The overview of this diagram is described as follows:
- Use CloudFront to deliver the Web GUI which is hosted on S3 bucket.
- The Web GUI leverages the REST API which behind APIGateway.
- Use AWSWAF to protect the API from attacks via web ACL.
- Leverage Cognito to authenticate users against Web UI and API Gateway.
- AWS Lambda hosts the business logic for the Rest API.
- Use CloudFormation to deploy the Use Cases.
- Amazon DynamoDB stores the data of deployments.
- Amazon CloudWatch monitors the performance of solution and operational health.
Deployment Process:
Download the cloudformation template from here
Deploy the downloaded template with inputs to the following parameters on AWS cloudformation console
Admin User Email
: your email addressDeployUI
: Yes
After the deployment is completed, you can get access to the Web UI as shown below
Deploy a Use Case such as Text based chatbot
Now you can start to chat with your LLM such as Amazon Nova Pro
Top comments (0)