DEV Community

Cover image for Skills and Day to Day for an AI Dev
Schuster Braun
Schuster Braun

Posted on

1

Skills and Day to Day for an AI Dev

This is a response to a Linkedin Post

I think the field for building Agentic AI systems lends itself to technologists with a wide array of skills. These systems use programmatic glue to chain and orchestrate multiple AI calls and systems together. Tools I've needed so far is a fine understanding of Python (Jupyter notebooks is nice) and access to an LLM. The specific AI skill I've leveraged most is inspecting and evaluating the output and updating my system accordingly. I've read quite a few research papers to help learn some of the design patterns being researched as well. I haven't deep dove the different models and have focused mostly on chaining and orchestration challenges.

Day to day:

  • Make an "Agent" (LLM call with user message and system message)

  • Save the output to a file, inspect that file (see if I like it or not). If no iterate on the prompts.

  • Make another Agent. Pipe the output from the last step into the new agent. Inspect new file output.

  • Find bug, refactor previous 2 agents, make third because I was asking too much from the last 2.

  • Once I understand what's goodish. Make evaluating/critiquing agent. If evaluations are good you can automate this pipeline by asking the evaluator if the task is complete.

  • Get a couple good pipelines and then start working on orchestrating between the pipes.

  • Oh, while you're doing all this it becomes more difficult to understand the system by looking at the text file outputs so you're going need to constantly tune your logging (observability) system so that you can determine Signal vs Noise.

Image of Timescale

🚀 pgai Vectorizer: SQLAlchemy and LiteLLM Make Vector Search Simple

We built pgai Vectorizer to simplify embedding management for AI applications—without needing a separate database or complex infrastructure. Since launch, developers have created over 3,000 vectorizers on Timescale Cloud, with many more self-hosted.

Read more →

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more