DEV Community

Paz Gruberg
Paz Gruberg

Posted on

Seeking advice on complex AI system architecture (NLP, Claude, parallel flows)

I'm developing a system and could use some expert insights on its architecture and implementation.

Here's a brief overview of the current flow:

  1. User fills out an intake questionnaire with X questions
  2. System references datasets/examples from existing system folders
  3. Multiple parallel flows run with Claude API to generate texts based on guidelines and relevant intake responses

Now, I'm grappling with some key issues:

  1. Overall Architecture
  2. Should I use Agentic AI frameworks? If so, which ones?
  3. Or is there a more efficient approach for a system like this?
  4. Data Storage and Management
  5. How to store intake responses for efficient AI flow access?
  6. Is RAG (Retrieval-Augmented Generation) advisable for storage and retrieval? If not, what are the alternatives?
  7. Existing Dataset Integration
  8. What's the most efficient way to incorporate examples from existing folders into the flow?
  9. Better to train a small model on the dataset or integrate it directly?
  10. Parallel Process Optimization
  11. How to efficiently manage and synchronize the parallel flows?

Important notes:

  • Output (generated texts) and number of intake questions remain constant
  • It's a complex flow split into several sub-flows, not a single long prompt

API Trace View

Struggling with slow API calls? πŸ‘€

Dan Mindru walks through how he used Sentry's new Trace View feature to shave off 22.3 seconds from an API call.

Get a practical walkthrough of how to identify bottlenecks, split tasks into multiple parallel tasks, identify slow AI model calls, and more.

Read more β†’

Top comments (0)

Eliminate Context Switching and Maximize Productivity

Pieces.app

Pieces Copilot is your personalized workflow assistant, working alongside your favorite apps. Ask questions about entire repositories, generate contextualized code, save and reuse useful snippets, and streamline your development process.

Learn more

πŸ‘‹ Kindness is contagious

Please leave a ❀️ or a friendly comment on this post if you found it helpful!

Okay