DEV Community: Jesus Marin

DevBlog #2 Image generation using Dalle-2

Jesus Marin — Thu, 20 Jul 2023 04:59:01 +0000

Hello Everyone!

This is the 2nd post of a series for my Development Blog, if you want to check my previous post click here: DevBlog #1 Autogenerated descriptions using OpenAI

Introduction

In the previous post I used Python, AWS Lambda and OpenAI API to generate descriptions for TTRPG Terrains Table and store those descriptions in a DynamoDB Table, now we are going to use dalle-2 to generate images using the description as a prompt and store the iamges in AWS S3.

Adding generate image function

For this function we are going to use Image.create function from openai, by default it will return a url that shows the image, but for this case we are going to retrieve the image in base64 so that way we can store it directly in AWS S3.

import os
import random
import boto3
import openai

terrains_table = [#code]

time_table = [#code]

def roll_dice(number):
    # code

def get_terrain_by_time(terrain_id, time_id):
    # code

def generate_terrain_description(terrain, time):
    # code

def generate_terrain_image(description):
    openai.api_key = os.getenv("OPENAI_API_KEY")

    response = openai.Image.create(
        prompt=description,
        n=1,
        size="512x512",
        response_format="b64_json",
    )

    return response["data"][0]["b64_json"]

def create_terrain(terrain_id, time_id, name, time, description):
    # code

def lambda_handler(event, context):
    terrain_id = roll_dice(6)
    time_id = roll_dice(2)
    terrain = terrains_table[terrain_id -1]
    time = time_table[time_id -1]
    item = get_terrain_by_time(terrain_id, time_id)

    if not item:
        description = generate_terrain_description(terrain, time)
        imageBase64 = generate_terrain_image(description)
        item = create_terrain(terrain_id, time_id, terrain, time, description)

    return item

At this point we just have the base64 value of the image stored in the imageBase64 variable, now we are going to save the image in AWS S3.

Creating the S3 Bucket and Environment variable

For this we just need to create a simple S3 bucket, no need to specify any properties or permissions as this is just for uploading the images.

Then create a new environment variable named BUCKET and assign the name of your S3 Bucket, as it will be used in the next function.

Also, don't forget to add S3 permissions to your Lambda execution IAM Role, so that way your function will have the required permissions for uploading images.

Adding upload image to s3 function

For this function we are going to specofy the value of the Object Body and assign the value from imageBase64 variable.

import os
import random
import boto3
import openai
import base64

terrains_table = [#code]

time_table = [#code]

def roll_dice(number):
    # code

def get_terrain_by_time(terrain_id, time_id):
    # code

def generate_terrain_description(terrain, time):
    # code

def generate_terrain_image(description):
    # code

def upload_base64_to_s3(bucket, key, base_64_str):
    s3 = boto3.resource('s3')
    s3.Object(bucket, key).put(Body=base64.b64decode(base_64_str))
    return f'https://{bucket}.s3.amazonaws.com/{key}'

def create_terrain(terrain_id, time_id, name, time, description):
    # code

def lambda_handler(event, context):
    terrain_id = roll_dice(6)
    time_id = roll_dice(2)
    terrain = terrains_table[terrain_id -1]
    time = time_table[time_id -1]
    item = get_terrain_by_time(terrain_id, time_id)

    if not item:
        description = generate_terrain_description(terrain, time)
        imageBase64 = generate_terrain_image(description)
        item = create_terrain(terrain_id, time_id, terrain, time, description)
        bucket = os.getenv("BUCKET")
        key = f"terrains/{terrain}-{time}.png"
        image_url = upload_base64_to_s3(bucket, key, imageBase64)
        item = create_terrain(terrain_id, time_id, terrain, time, description, image_url)

    return item

Note that we've added a the base64 import and a new property in the create_terrain function, so we need to update that function as well.

Updating create terrain function

import os
import random
import boto3
import openai
import base64

terrains_table = [#code]

time_table = [#code]

def roll_dice(number):
    # code

def get_terrain_by_time(terrain_id, time_id):
    # code

def generate_terrain_description(terrain, time):
    # code

def generate_terrain_image(description):
    # code

def upload_base64_to_s3(bucket, key, base_64_str):
    # code

def create_terrain(terrain_id, time_id, name, time, description, image_url):
    dynamodb = boto3.resource('dynamodb')
    table = dynamodb.Table('Terrains')

    item = {
        'terrain_id': terrain_id,
        'time_id': time_id,
        'terrain': name,
        'time': time,
        'description': description,
        'image': image_url
    }

    response = table.put_item(Item=item)
    if response['ResponseMetadata']['HTTPStatusCode'] == 200:
        return item
    else:
        return None

def lambda_handler(event, context):
    terrain_id = roll_dice(6)
    time_id = roll_dice(2)
    terrain = terrains_table[terrain_id -1]
    time = time_table[time_id -1]
    item = get_terrain_by_time(terrain_id, time_id)

    if not item:
        description = generate_terrain_description(terrain, time)
        imageBase64 = generate_terrain_image(description)
        item = create_terrain(terrain_id, time_id, terrain, time, description)
        bucket = os.getenv("BUCKET")
        key = f"terrains/{terrain}-{time}.png"
        image_url = upload_base64_to_s3(bucket, key, imageBase64)
        item = create_terrain(terrain_id, time_id, terrain, time, description, image_url)

    return item

Here we just need to add the image_url property in the function definition and add a new image_url value in the item object.

Final result

If everything went well each time you test your Lambda function a new record will be stored in DynamoDB and store the image in S3, here is an example:

{
 "terrain_id": 3,
 "time_id": 2,
 "description": "The night sky is illuminated by the stars and the moon, casting a pale light over the mountain range. The jagged peaks of the mountains are silhouetted against the night sky, creating a majestic and awe-inspiring sight. The air is crisp and cool, and the silence of the night is broken only by the occasional sound of a distant animal.",
 "image": "https://{your-s3-bucket}.s3.amazonaws.com/terrains/Mountains-night.png",
 "terrain": "Mountains",
 "time": "night"
}

The image in this post was generated using the above criteria.

That's all for this post, in the next one probably I'll do some refactor as the code can get bigger, and it is better to have it in separate files.

Stay tuned!

Cover generated using OpenAI Dalle-2

DevBlog #1 Autogenerated descriptions using OpenAI

Jesus Marin — Fri, 14 Jul 2023 04:37:34 +0000

Hello Everyone!

This is the first post of a series for my Development Blog, if you want to know what this is about you can check my previous article DevBlog #0 Introduction.

Introduction

OSR TTRPG Games have a lot of reference tables, such as places, monsters, weapons, and in this article I'll try to make autogenerated content using OpenAI for a Terrains Table.

I want to generate description of the following terrains:

Valley
Forest
Mountains
Grasslands
Desert
Swamp

And the description can vary depending on if it is day or night.

Creating RandomTableGenerator Lambda function

For this I'm going to use a Lambda Function using Python, So I have created a function called: RandomTableGenerator using Pyhton 3.8 version.

For the purpose of this post I'm going to just use the default lambda handler: lambda_function.lambda_handler that comes already in the lambda function.

Adding roll dice function

The first thing we need to do is to add a function that returns a random number and two variables to get the value of the dice.

import random

terrains_table = [
    "Valley",
    "Forest",
    "Mountains",
    "Grasslands",
    "Desert",
    "Swamp"
]

time_table = [
    "day",
    "night"
]

def roll_dice(number):
    result = random.randint(1, number)
    return result

def lambda_handler(event, context):
    terrain_id = roll_dice(6)
    time_id = roll_dice(2)
    terrain = terrains_table[terrain_id -1]
    time = time_table[time_id -1]
    print(terrain)
    print(time)

Creating Terrains DynamoDB Table

Now that we have the terrain value and time value, we are going to look in a DynamoDB table if the item already exists.

For this I'm going to create a Terrains DynamoDB Table using terrain_id as the partition_key and time_id as the sort_key, that way I can get the item using both values.

Adding get terrain by time function

Now we need to add the code to look for items and create items if those doesn't exists.

import random
import boto3

def roll_dice(number):
    # code

def get_terrain_by_time(terrain_id, time_id):
    dynamodb = boto3.resource('dynamodb')
    table = dynamodb.Table('Terrains')

    response = table.get_item(
        Key={
            'terrain_id': terrain_id,
            'time_id': time_id
        }
    )

    item = response.get('Item')
    if not item:
        return False

    return item


def lambda_handler(event, context):
    terrain_id = roll_dice(6)
    time_id = roll_dice(2)
    terrain = terrains_table[terrain_id -1]
    time = time_table[time_id -1]
    item = get_terrain_by_time(terrain_id, time_id)

    if not item:
        # item doesn't exist

    return item

Adding create terrain function

Now we are going to create a new function for creating the item.

import random
import boto3

def roll_dice(number):
    # code

def get_terrain_by_time(terrain_id, time_id):
    # code

def create_terrain(terrain_id, time_id, name, time, description):
    dynamodb = boto3.resource('dynamodb')
    table = dynamodb.Table('Terrains')

    item = {
        'terrain_id': terrain_id,
        'time_id': time_id,
        'terrain': name,
        'time': time,
        'description': description
    }

    response = table.put_item(Item=item)
    if response['ResponseMetadata']['HTTPStatusCode'] == 200:
        return item
    else:
        return None

def lambda_handler(event, context):
    terrain_id = roll_dice(6)
    time_id = roll_dice(2)
    terrain = terrains_table[terrain_id -1]
    time = time_table[time_id -1]
    description = ""
    item = get_terrain_by_time(terrain_id, time_id)

    if not item:
        item = create_terrain(terrain_id, time_id, name, time, description)

    return item

Ok now if the item we are looking for doesn't exist it will create the item and return it.

Adding OpenAI Lambda Layer

In the next step we are going to generate some description based on our input using OpenAI.

Note: OpenAI package is not availble in AWS Lambda, so what we need to to is to add a Lambda Layer containing the openai package and its dependencies, fortunately the GitHub User: erenyasarkurt (shootout to him) created a repository with releases of this lambda layet, you can find these release in the following GitHub Repo: erenyasarkurt/OpenAI-AWS-Lambda-Layer.

Download the release for your Python version and create a new layer in Lambda, after that update your Lambda function to use the layer.

Now go to Configuration / Environment variables and create a new variable called OPENAI_API_KEY and add your key as the value.

If you don't have an OpenAI API Key you can signup and create a key, you can also follow this OpenAI Introduction.

Adding generate terrain description function

Now that we have our openai layer and our key in an environment variable, we can continue with the code.

The next step is to create a new funcion that will generate a description based on the terrain and time.

import os
import random
import boto3
import openai

def roll_dice(number):
    # code

def get_terrain_by_time(terrain_id, time_id):
    # code

def generate_terrain_description(terrain, time):
    openai_api_key = os.environ.get("OPENAI_API_KEY")
    prompt_template = """I am scene description Game Master. 
        You can give me description criteria and I will describe the scene only with the given description criteria.
        My answer will be a paragraph no longer than 4 lines and will use a description in a Game Master Syle.
        \n
        \nDescription criteria:
        \n- Terrain: _terrain_
        \n- Time of the day: _time_
        \n"""
    my_prompt = prompt_template.replace("_terrain_", terrain)
    my_prompt = my_prompt.replace("time", time)
    response = openai.Completion.create(
        model="text-davinci-003",
        prompt=my_prompt,
        temperature=0,
        max_tokens=100,
        top_p=1,
        frequency_penalty=0.0,
        presence_penalty=0.0,
        stop=["\n"]
    )
    return response.choices[0]["text"]

def create_terrain(terrain_id, time_id, name, time, description):
    # code

def lambda_handler(event, context):
    terrain_id = roll_dice(6)
    time_id = roll_dice(2)
    terrain = terrains_table[terrain_id -1]
    time = time_table[time_id -1]
    item = get_terrain_by_time(terrain_id, time_id)

    if not item:
        description = generate_terrain_description(terrain, time)
        item = create_terrain(terrain_id, time_id, terrain, time, description)

    return item

Final result

If everything went well, you will have the following output in your Lambda function:

{
    "terrain_id": 2,
    "time_id": 2,
    "description": "The forest is shrouded in darkness, the only light coming from the stars and the moon. The trees stand tall and silent, their branches swaying gently in the night breeze. The air is still and the only sound is the occasional chirp of a night bird.",
    "terrain": "Forest",
    "time": "night"
}

So that's all for this article, in the next one I plan to generate images using Dall-e-2 and adding all the code in a GitHub Repository.

Stay tuned!

Cover by @andrewtneel

DevBlog #0 Introduction

Jesus Marin — Fri, 14 Jul 2023 03:45:22 +0000

Hello Everyone!

I'm a DevOps Engineer who is passionate about technology, and I've always wanted to start a development blog. I've had many different ideas, but nothing that I truly wanted to pursue.

Recently, I've become interested in OSR (Old School Renaissance/Revival) TTRPG Books due to their art style and fantasy content. I've enjoyed video games such as Fallout, Diablo, and Disco Elysium, which have a rich amount of content and lore.

I've been working on some game concepts to create a hybrid between a video game and a TTRPG. Therefore, I'm starting a series of development articles to document my progress.

Next: DevBlog #1 Autogenerated descriptions using OpenAI