AI-Hub-Admin

Posted on Aug 25

Codex Claude+ Craftsman Agent CLIs Skills Turn Design Ideas to AI Toy 3D Generator Tutorial

#ai #agentskills #agents #3dprinting

Hi community, In this blog I will introduce how to use your local Agent (Codex/Claude/Gemini) and Craftsman Agent API/Skills to turn your creative ideas or IP into ready to production Toys (AI Figurine,Plush Stuffed Toys) multiview sheets and and 3D models.

Requirements:

Your Local Agents Codex/Claude/Gemini CLIs/Workbuddy
Craftsman Agent Skills(https://github.com/AI-Hub-Admin/Craftsman-Agent), Especially the toy_generator skills,(toy_generator_design_draft,toy_generator_task_create,toy_generator_task_poll)
OneKey Agent Gateway Access Key: DEEPNLP_ONEKEY_ROUTER_ACCESS Required to use the SOTA Image Generation (Nano Banana/Image Gen ) and 3D models APIs (Tripo/Meshy) in the toy design agentic workflow which can be access using OneKey MCP CLI or APIs.

You can generate:

Multiview sheet of your creative IPs Design.
3D models(.obj,.glb) ready for 3D printing and Plush Toy Manufacturing on Craftsman Agent Store, which is the manufacturing on Demand platform to connect to 1000+ craftsman workshop and turn your design to finished products and delivery.
To view your generation, visit the Craftsman Agent Toy Generator Web app with the shared URL

Here is a gallery of demo generated Plush Toy Steve in Minecraft, PVC Materials AI Figurine Steve/Alex/Kulipa, etc.
And Even the Cult Movie Character Niulai (Cow)

Tutorial

The typical workflow of AI Toy 3D Generator is as below:

[Text/Image Prompt]
        ->
[Toy Design Draft / Multi-View Sheet]
        ->
[Create 3D Generation Task: Task ID]
        ->
[Poll Task Results Progress using Task ID]
        ->
[3D Toy Model + Preview]

1. Setup Agent Skills Craftsman Agent

In your local project folder, setup the skills markdown file by running below commands to download skills from GitHub or Clawhub

npx skills add ai-hub-admin/craftsman-agent

openclaw skills install @ai-hub-admin/toy-generator

You can download the toy-generator and more specific usage from the hub. The raw skills data can be found in GitHub Repo

https://github.com/AI-Hub-Admin/Craftsman-Agent

2. Running Skills

2.1 Generate Toy 3D Model MultiView Sheets Images

Example: I am using the Niulai (A Cow) Cult Movie for low resolution animation screenshots images as references. Niulai Movie Cow Picture :

You can be specific about which kind of toys you would like, such as the Plush Stuffed Animal Toys or AI Figurine (PVC materials), 3D Printing Materials, etc. You can also define the texture of the toys to make it better

Setup the Env Variables before Running the Skills APIs, Otherwise you will an Key not found error! You can get the onekey access variables and demo credits at https://deepnlp.org/workspace/keys.

export DEEPNLP_ONEKEY_ROUTER_ACCESS=your_access_key

This is the final Prompt

Please follow the reference pictures of the Movie Niulai of a standing Cow. Please Output a multiview sheets images of stuffed toy. 
Background should be white. Facial Expression should resemble the main face. Texture of the cow should be exact like the main picture, coarse grain texture.
Use the raw character images as references: https://craftsman-agent.aiagenta2z.com/static/ogino-chihiro/50923d3d-8222-45ce-989e-4c41ec15e3ab/3fd95298d85b42389415cd8d5f8227cd.jpg

The Output of the MultiView Sheets will give the Front View, Side View and Back View of the toys when the skills runs

Multi View Sheets of Craftsman Agent Niulai

This file will be ready to send to Manufacturing Supplier to make it out and the factory will print out the design, get modules of plush materials and make Demo Toys!
Just upload the generated images to marketplace, and make will order to find Craftsman and your order will be matched in Craftsman Agent Store Manufacturing on Demand

2.2 Generate 3D Models for 3D Printing or AI Figurine

If you want to use 3D Printing to print out the model and paint. You can try below prompts and output a 3D models calls the default SOTA 3D generation APIs (Tripo/Meshy/etc). Note that the 3D generate have 3 models (image-to-model, text-to-model, multi-view sheets to model)

The Online 3D Viewer of Generated 3D Toys of Niulai Cow

In this blog we use the outputs of previous step 2.1 MultiView Sheets and produce a more accurate models. Alternatively, you can also
use just single images to generate (But the back and side e.g. the tail of the cow might be different than your expectations.)

Use Craftsman Agent Toy Generator Skills to Generate 3D Models of Niulai. Use the previously generated MultiView Sheets Front, Side and Back Images to generate 3D Models ready to ship.

Note that the 3D Generate Takes Minutes the process work like this:

Toy 3D Generation Start -> Generate Task ID task_id -> Polling on Task ID task_id progress to get final results

Get the Task View From the First API Calls

From the First API calls Get the 3D ShareURL Views

Field	Description
session_id	The generation unique session id
share_url	To View the Generated Images or Slides in Workspace

The is a final generated gallery of 3D models Polling:

A Demo URL Path of Generated 3D models Ready to Download: (Path are marked in Tutorial and live for a lifecycle)

https://us-static.aiagenta2z.com/xxxxxxxx/user_name/session_id/tripo_pbr_model_990f448b-d8b8-491e-8d9f-284802aa985c.glb

And This is the final Toy generated 3d files ready to print/manufacture. Visit the console to download files.

Niulai Cow 3D Models Gallery

Find more information about how to use skills visit:

3D Generator
Image Generator
Toy Generator
Craftsman Gallery
Perler Beads Pattern Generator
Craftsman Agent Store MOD Manufacturing on Demand

DEV Community