DEV Community: Luis

Plugin for Cloudflare AI API

Luis — Tue, 16 Apr 2024 20:18:32 +0000

I created a module for @luisfun/cloudflare-ai-plugin, and this is its introduction.

What I Built

This plugin enables you to write REST API or AI Gateway in the same way as binding AI (env.AI.run) when using Cloudflare's Workers AI.
Also, it supports Typescript.

How to Use

Install

npm i @luisfun/cloudflare-ai-plugin
npm i -D @cloudflare/ai # When using TypeScript

Coding

import { Ai } from '@luisfun/cloudflare-ai-plugin'

// const ai = env.AI
const ai = new Ai(env.AI_API_URL, env.AI_API_TOKEN)

const response = await ai.run(model, inputs)

How to get API URL and TOKEN

There are also some extensions available.
Here, I will include the cache control of the Gateway.
If you are interested in other extensions, please check the repository.

const options = {
  'cf-skip-cache': true,
  'cf-cache-ttl': 60,
}
const response = await ai.run(model, inputs, options)

Repository

https://github.com/LuisFun/cloudflare-ai-plugin

Discord Bot with Cloudflare AI

Luis — Sat, 13 Apr 2024 12:27:14 +0000

This is a submission for the Cloudflare AI Challenge.

What I Built

Discord Bot for asking questions to AI or generating images

Demo

Discord Bot: https://discord.com/oauth2/authorize?client_id=1227951760539258880&permissions=0&scope=bot

My Code

Repository: https://github.com/LuisFun/discord-bot-cloudflare-ai-challenge

Journey

I realized that most of the projects that have been submitted so far were in the form of websites, as we are in the latter half of the challenge period.
Therefore, as a different approach, I tried creating a simple application using a discord bot.

The main thing I worked on during the challenge period was creating and publishing a plugin package.

Stacks

Cloudflare
Discord Bot
discord-hono (I made it)
@luisfun/cloudflare-ai-plugin (I made it)

@luisfun/cloudflare-ai-plugin can do the following:

AI Gateway - You can code the AI Gateway in the same way as the workers AI.
MD Translator - You can translate while maintaining the structure of Markdown to some extent.

By using the module and plugin that I created, the server code for the Bot was 80 lines, and the command registration code for the Bot was 50 lines. In this way, I was able to create a Bot with such a small amount of code.

Multiple Models and/or Triple Task Types

All Text Generation models
All Text to Image models
@cf/meta/m2m100-1.2b

If the language set in the discord is not English, the default behavior is to process as follows
Translate prompt -> Generate text or image (-> Translate text)
In the second translation, I made sure not to break the markdown format.

Image Generator with Cloudflare

Luis — Thu, 11 Apr 2024 08:34:19 +0000

This is a submission for the Cloudflare AI Challenge.

What I Built

Simple App for Text to Image.
In addition, image modification using img2img or inpainting models.

Demo

Web Site: https://ai-paint.luis.fun

My Code

Repository: https://github.com/LuisFun/ai-paint
License: AGPL-3.0

Journey

I had been developing an app that could generate images on a website even before the challenge started. This time, I applied because it roughly matched the entry requirements of the challenge.

During the challenge period, I worked on the following:

Utilized Workers AI through the AI Gateway
Enabled the enlargement of uploaded image
Implemented the inpainting mode

Stacks

Cloudflare
Svelte kit
Skeleton
@luisfun/cloudflare-ai-plugin (I made it)

The two things I focused on when creating the frontend were eliminating unnecessary UI and making the UI more understandable.

What I kept in mind when creating the backend was to protect the AI-related API from bot attacks.
I achieved this using the AI Gateway and Turnstile.

AI Gateway can utilize Real-time logs, Caching, and Rate-limiting.
Turnstile determines whether it's a human or a bot, and blocks appropriately.

Multiple Models and/or Triple Task Types

@cf/lykon/dreamshaper-8-lcm
@cf/runwayml/stable-diffusion-v1-5-img2img
@cf/runwayml/stable-diffusion-v1-5-inpainting
@cf/meta/m2m100-1.2b

When the language of the Prompt is specified as something other than EN, the Prompt is first translated into English using m2m100-1.2b, and then the translated Prompt is input in image generation.
(You can select this if the default language of your browser is not EN.)

The img2img model automatically switches when an image is uploaded.

The inpainting model automatically switches when a mask is added.

P.S.

The project's code includes code to display Adsense.
Originally, considering long-term operation, it was added as one means to recover operating costs.
However, considering the submission requirements, the ads are hidden during the challenge period (throughout April).

(Apr 13) I have installed the @luisfun/cloudflare-ai-plugin that was created in this project.