📯 Hi, this is Cyber postman talking 🎙️

#api #ai #showdev #python

🎯 About

At opt-nc, we have APIs to track package delivery as well as a web portal for end users called "OPT-NC Mon espace":

The purpose of this story telling is to show how we could imagine a performance that consists in :

creating a customized AI-driven digital assistant thanks to public APIs, on free tiers.

👨‍🍳 The recipe

Find the recipe below:

📦 A package id (as input)
🔑 Get API credentials (as inputs)
🎙️ Generate a whole speech in a high quality mp3 (and listen some bugs too 😅)
🤓 Do something fun with mp3

🧰 `APis` as ingredients

We will rely on:

📦 opt-nc/suivi-colis to track package
🤖 llElevenLabs for Text-to-Speech
😭 SadTalker to build a movie clip

ℹ️ Notice that as all have free plans, you can run (and change this code) for free at you own convenience, as long as it's not for commercial purpose.

🍿 Build the soundtrack

That said, let's take a look at demo and have some fun, first, build the soundtrack (see 🏤 Suivi colis 🤖 🎙️ Notebook for more):

🎞️ Bring "Cyber Postman to life" ⚡

To build the movie clip, we need two ingredients:

🎙️ A soundtrack: the one we have just built (mp3)
🎭 An avatar: the one I've built myself on bluewillow.ai

Next, with some parameter tweaks on Sad Talker, we can bring our cyber postman to life:

🔭 The "Customer Experience" screenwriter

Beyond the fun, it makes appear the need to work on the delivery scenario speech which may be achieved in different ways:

📜 Hard code the scenario with placeholders (current version) : you can get help from chatBOTs, yet the final version is static
🦾 Use variables (location, status,...) and inject into AGI ... and get an original script with a PROMPT template, play with temperature and get original content while keeping control
🤯 Hybrid of previous ones : create a template, get an output then ask to AGI to build a brand new one on top of it and carefully design a system context

From my very own point of view, the emergence of the screenwriter role is the most exciting one.