DEV Community: donvitocodes

Using Bun 1.0 for Serving APIs with Vercel AI SDK and OpenAI

donvitocodes — Thu, 14 Sep 2023 15:32:10 +0000

Just a few days ago, the much-anticipated Bun 1.0 was launched, bringing a fresh perspective to the world of JavaScript. This new Javascript runtime and toolkit, etc. promises the fastest execution times and better developer experience.

Although I come from a backend development background and wouldn’t consider myself a seasoned JavaScript expert, I’ve always had an interest in exploring the various tools and frameworks. So, when Bun 1.0 made its debut a few days ago, I felt compelled to dive in and see what it had to offer, especially given that this realm is somewhat new to me.

Since I am playing around with OpenAI, I created a simple API using Bun and the Vercel AI SDK. The API serves chat completion requests from the chat web application I built using NextJS 13 and shadcn/ui.

It was really nice since it supports streaming out of the box! Since I already implemented the API in Next13, it was pretty straightforward to port the code to Bun.

const response = await openai.chat.completions.create({
                    model: 'gpt-3.5-turbo',
                    messages,
                    stream: true,
                });

// Assuming OpenAIStream is a function that processes the response for streaming - not working yet
const stream = OpenAIStream(response);

// Return the streaming response - not working yet
return new StreamingTextResponse(stream,
    { headers: corsResponseHeaders });

Here’s a demo of the Chat application I built. The API being consumed by the web application in the left is the one created using Bun.

Here's the full source code of the API I built using Bun and Vercel AI SDK.

import OpenAI from 'openai';
import { OpenAIStream, StreamingTextResponse } from 'ai';

const openai = new OpenAI({ apiKey: Bun.env.OPENAI_API_KEY });

const corsResponseHeaders = {
    "Access-Control-Allow-Origin": "*",
    "Access-Control-Allow-Methods": "POST, GET, OPTIONS",
    "Access-Control-Allow-Headers": "X-PINGOTHER, Content-Type",
    "Access-Control-Max-Age": "86400"
}

const server = Bun.serve({
    port: 3001,
    async fetch(req) {
        if (req.method === 'POST') {
            try {

                const { messages } = await req.json();

                const response = await openai.chat.completions.create({
                    model: 'gpt-3.5-turbo',
                    messages,
                    stream: true,
                });

                // Assuming OpenAIStream is a function that processes the response for streaming - not working yet
                const stream = OpenAIStream(response);

                // Return the streaming response - not working yet
                return new StreamingTextResponse(stream,
                    { headers: corsResponseHeaders });               

            } catch (error) {
                console.log("Error: ", error);
                // Return an error response
                return new Response("Internal Server Error",
                    {
                        status: 500,
                        headers: corsResponseHeaders
                    },

                );
            }
        } else {
            // Handle other request methods or return a default response
            return new Response("Not Found", { status: 404,
                headers: corsResponseHeaders });
        }
    },
});

console.log(`Listening on localhost: ${server.port}`);

If you like my article, you can follow me and subscribe here in Medium for more. You can also support me by buying me a coffee!

You can also follow me in my social media. Cheers!

🐦 twitter.com/donvito
🔗 linkedin.com/in/melvinvivas
👾 github.com/donvito
🔗 donvitocodes.com

[reposted from] https://techblogs.donvitocodes.com/using-bun-1-0-for-serving-apis-with-vercel-ai-sdk-and-openai-e6d01fedd2ca

What's a good programming language to help teach beginners?

donvitocodes — Sat, 20 Aug 2022 04:53:00 +0000

I'm looking for some advise. What's a good programming language to help teach beginners? Let's talk about it later in my stream @ 2pm Singapore time today(an hour from now).

Catch me live @ https://twitch.tv/donvitocodes

Hope to hear from those who started programming also. What language were you comfortable of using?

Astro 1.0 is out! Let's check it out! Did a live demo in my Twitch Channel

donvitocodes — Sat, 13 Aug 2022 13:53:00 +0000

For those who missed my stream earlier, we took Astro 1.0 for a spin! It was really a delightful experience! Check out the replay here https://www.twitch.tv/videos/1560582959 to see how we ran an example blog using Astro.

Check out Astro here https://astro.build/

You can follow me in Twitch to get live notifications.

Replay is also available in my youtube channel

Finally migrated my blog to Gatsby

donvitocodes — Sun, 15 Aug 2021 12:52:42 +0000

Finally migrated my tech blog https://www.melvinvivas.com to GatsbyJS -https://www.gatsbyjs.com. I ran Lighthouse and it's definitely worth it! Now, my blog does not need a VM anymore. :)

Will blog about the why I migrated from Ghost(https://ghost.org/) to Gatsby soon!

Developing a Zoom API Client Library for Golang

donvitocodes — Sat, 23 May 2020 09:38:05 +0000

Repost from my tech blog
https://www.melvinvivas.com/zoom-api-golang-library/

I thought of developing a Zoom API Golang Client Library for my personal use. There is no official Zoom API client library for Go/Golang so I thought it would be interesting to develop one.

Why Zoom?

Zoom is very popular during this crisis and most businesses and schools are using it. Zoom is also used by families and friends to get in touch during this trying times. This popularity will also give rise to the need to integrate with Zoom.
There is no official Zoom API client library for Go/Golang.
I wanted an interesting project to practice my Golang skills and at the same time be able to create something useful for fellow Gophers.
It would be interesting to know how Go developers will integrate Zoom into their applications.

Here is the github project if you would like to take a peek. I'd really appreciate it if you can give it a star if you liked it or find it useful. Stars will really give me motivation to spend more time on it and implement more functionality. :)

donvito / zoom-go

Zoom (Zoom.us) API Golang client library

Zoom(zoom.us) API Golang Client Library

This is an unofficial Go client library for the Zoom API. I've just started and implemented the ff:

List Meetings
Create Meetings
Delete Meeting
Get Meeting by Id
Get Meeting Invitation
Add Meeting Registrant
List Meeting Registrants
Update Meeting Status/End Meeting

This library is in its infancy and has not been tested yet for production use.

Zoom API version supported

Version: 2.0.0
Host: api.zoom.us/v2

Usage

Set Environment Variables

    export ZOOM_API_URL="https://api.zoom.us/v2"
    export ZOOM_AUTH_TOKEN="<your jwt token>"
    export ZOOM_USER_ID="<your email or username>"

How to get your Zoom JWT token

You will need a paid account to access Zoom's REST API. You need to create a JWT App in the App Marketplace Then, get a JWT token from the App Credentials of the app you just created. Check the instructions here https://marketplace.zoom.us/docs/guides/build/jwt-app

Download the library to your project

go get

…

View on GitHub

I am very busy with my daytime job so I only work on the library during late nights and weekends. So far, I have implemented the ff. functionality.

List Meetings
Create Meeting
Delete Meeting
Get Meeting by Id
Get Meeting Invitation

This library is in its infancy and has not been tested for production use.

To use the library, you will need a paid account to access Zoom's REST API. Unfortunately, free or basic accounts do not have access to the APIs. You need to create a JWT App in the Zoom App Marketplace and get a JWT token from App Credentials. Here are the instructions I followed to get me started.

https://marketplace.zoom.us/docs/guides/build/jwt-app

Image from Zoom Documentation

The zoom-go library uses environment variables to configure the API client. Here are the required environment variables.

    export ZOOM_API_URL="https://api.zoom.us/v2"
    export ZOOM_AUTH_TOKEN="<your jwt token>" 
    export ZOOM_USER_ID="<your email or username>"

Download the library to your project

go get "github.com/donvito/zoom-go/zoomAPI"

List Meeting example

func listMeetingExample() {

    //Create a new Zoom API client
        apiClient := zoomAPI.NewClient(os.Getenv("ZOOM_API_URL"), os.Getenv("ZOOM_AUTH_TOKEN"))

        //Retrieve the userId from the env variable
        userId := os.Getenv("ZOOM_USER_ID")

        //Use the client to list meetings
        var resp zoomAPI.ListMeetingsAPIResponse
        var err error

        resp, err = apiClient.ListMeetings(userId)
        if err != nil {
            log.Fatal(err)
        }

        for _, meeting := range resp.Meetings {
            fmt.Printf("id = %d, topic = %s, join url = %s, start time = %s\n", meeting.Id, meeting.Topic, meeting.JoinUrl, meeting.StartTime)
        }

}

Create Meeting example

func createMeetingExample() {
    //Create a new Zoom API client
        apiClient := zoomAPI.NewClient(os.Getenv("ZOOM_API_URL"),
            os.Getenv("ZOOM_AUTH_TOKEN"))

        //Retrieve the userId from the env variable
        userId := os.Getenv("ZOOM_USER_ID")

        //Use the API client to create a meeting
        var resp zoomAPI.CreateMeetingResponse
        var err error

        resp, err = apiClient.CreateMeeting(userId,
            "Contributors Meeting for Project",
            meeting.MeetingTypeScheduled,
            "2020-05-24T22:00:00Z",
            30,
            "",
            "Asia/Singapore",
            "pass8888", //set this with your desired password for better security, max 8 chars
            "Discuss next steps and ways to contribute for this project.",
            nil,
            nil)
        if err != nil {
            log.Fatal(err)
        }

        fmt.Printf("Created meeting : id = %d, topic = %s, join url = %s, start time = %s\n", resp.Id, 
                resp.Topic, resp.JoinUrl, resp.StartTime)

}

Golang Jobs in Singapore

donvitocodes — Sat, 21 Mar 2020 14:53:49 +0000

I'm developing a micro-site built with React and Ant Design to aggregate/curate Golang Developer or Engineer jobs here in Singapore. I also used Go for the data gathering.

The site has Golang Developer or Engineer roles and also Go-related jobs like Software Engineering Manager roles, DevOps, Site Reliability Engineers, Data Engineers, which require Go knowledge or experience. Job posts are from different job sites here in Singapore. The site only shows titles and summaries of the job openings and will always link to the original job post where you can apply or send your resume to. The purpose of the site is to have one place to search for a Go developer role. This has been a challenge for me before and I thought that this is something which will be useful to those looking for Go-related jobs here in Singapore.

So far, the site has job postings from Indeed, LinkedIn and JobsDB, the more popular job websites here. I'll be adding more when I have time. Hope it is useful to those looking for golang work here in Singapore. I haven't bought a domain and do proper styling though and I'm still finalizing some ideas on how to proceed with it. Any feedback or ideas are greatly appreciated.

Check it out here!

https://golang-jobs.now.sh/

You can bookmark this blog post since I might change the link to a proper domain. Would love to know if it helps!

What's the longest stretch you've done at work?

donvitocodes — Mon, 30 Dec 2019 05:39:12 +0000

Mine's 3 days(Friday to Sunday). Had some short naps though. We needed to fix a production issue which was not even caused by our team.:D We had to deploy a new version of our application(a replacement of the one which caused the issue) to resolve it. News reached us that we need to stay reached us on Friday late afternoon, around 5pm and we were able to go back home on Sunday afternoon. I was 15 younger then so I was able to cope. I even went to work the following Monday.

How about you, what's your longest stretch?

Working long hours for companies

donvitocodes — Tue, 24 Dec 2019 03:51:50 +0000

Saw a couple of tweets from Jason Fried, I agree with this. What's sad about this is that some workers just accept this as reality as long as they are paid high. At some point, I thought this was reality until my mind can't take it anymore - got burned out - so I had to quit my job. I always thought it was my problem that I am not resilient enough.

// Detect dark theme var iframe = document.getElementById('tweet-1209115637148274690-749'); if (document.body.className.includes('dark-theme')) { iframe.src = "https://platform.twitter.com/embed/Tweet.html?id=1209115637148274690&theme=dark" }

// Detect dark theme var iframe = document.getElementById('tweet-1209116327664848898-519'); if (document.body.className.includes('dark-theme')) { iframe.src = "https://platform.twitter.com/embed/Tweet.html?id=1209116327664848898&theme=dark" }

The Phoenix Project kindle book free for 24hrs! You’re welcome. 😊

donvitocodes — Thu, 19 Dec 2019 10:30:45 +0000

// Detect dark theme var iframe = document.getElementById('tweet-1207569267778105344-298'); if (document.body.className.includes('dark-theme')) { iframe.src = "https://platform.twitter.com/embed/Tweet.html?id=1207569267778105344&theme=dark" }

Ant Design vs. Material UI

donvitocodes — Tue, 17 Dec 2019 04:13:36 +0000

So Ant Design(54,504 stars) has surpassed Material UI(53,012 stars) in github. 😎

Which do you use? If not these 2, how do you style your UI?

You can also vote in Twitter. Will post results here once polling is closed.
// Detect dark theme var iframe = document.getElementById('tweet-1206788400646221826-927'); if (document.body.className.includes('dark-theme')) { iframe.src = "https://platform.twitter.com/embed/Tweet.html?id=1206788400646221826&theme=dark" }

ant-design / ant-design

An enterprise-class UI design language and React UI library

Ant Design

An enterprise-class UI design language and React UI library.

English | 中文

✨ Features

🌈 Enterprise-class UI designed for web applications.
📦 A set of high-quality React components out of the box.
🛡 Written in TypeScript with predictable static types.
⚙️ Whole package of design resources and development tools.
🌍 Internationalization support for dozens of languages.
🎨 Powerful theme customization based on CSS-in-JS.

🖥 Environment Support

Modern browsers
Server-side Rendering
Electron

Edge	Firefox	Chrome	Safari	Electron
Edge	last 2 versions	last 2 versions	last 2 versions	last 2 versions

📦 Install

npm install antd

yarn add antd

🔨 Usage

import React from 'react';
import { Button, DatePicker } from 'antd';

const App = () => (
  <>
    <Button type="primary">PRESS ME</Button>
    <DatePicker placeholder="select date" />
  </>
);

TypeScript

…

View on GitHub

mui / material-ui

MUI Core: Ready-to-use foundational React components, free forever. It includes Material UI, which implements Google's Material Design.

MUI Core

MUI Core contains foundational React UI component libraries for shipping new features faster.

Material UI is a comprehensive library of components that features our implementation of Google's Material Design system.
Joy UI is a beautifully designed library of React UI components.
Base UI is our library of "unstyled" components and low-level hooks. With Base, you gain complete control over your app's CSS and accessibility features.
MUI System is a collection of CSS utilities to help you rapidly lay out custom designs.

Stable channel v5

Installation

Material UI

Material UI is available as an npm package.

npm:

npm install @mui/material @emotion/react @emotion/styled

yarn:

yarn add @mui/material @emotion/react @emotion/styled

Older versions

Note: @next only points to pre-releases Use @latest for the latest stable release.

Base UI

Base…

View on GitHub

Just discovered Interactive Sandboxes in O'Reilly Learning!

donvitocodes — Mon, 09 Dec 2019 13:11:41 +0000

I've renewed my subscription with O'Reilly Online Learning. A subscription would set you back at US$399 per year. I got their Cyber Monday promo so I got it for $200 off. Before they only have online access to technical books but now they are now offering video courses and sandboxes!

I was looking for something to read and I just discovered these new features. I think they call them Interactive Sandboxes.

They have now have sandboxes for Ubuntu, Kubernetes, Python and TensorFlow. Below are some screenshots I took.

Ubuntu Sandbox

I installed Go. :)

VSCode is even available in the sandbox.

Editing Go code in the IDE

Weave Scope - I guess this can be used to visualise docker containers.

Kubernetes Sandbox

Python Sandbox

Disclaimer: I am not paid by O'Reilly for this post. Just wanted to share since these new features can be useful for learning while reading a technical book without having to bring up an environment to code in.

Where can we find nice Gatsby themes?

donvitocodes — Wed, 27 Nov 2019 04:10:45 +0000

Aside from the Theme Jam Showcase, where can we find nice GatsbyJS templates?

What's your Gatsby themes wish list?