What I Built
A continuous intelligence pipeline that scrapes Elon Musk related posts, enriches them with Bright Data, and then passes the results to an AI Agent that classifies them by company. Finally, the output is submitted to Airtable where it powers a live dashboard of Musk’s shifting focus.
Demo
Google Drive Video - Explaining the workflow
n8n Workflow
Airtable Dashboard
Technical Implementation
System Instructions
The agent is instructed to classify scraped post content into exactly one of six Elon Musk companies (Tesla, SpaceX, Neuralink, BoringCompany, X, xAI). It also has rules to mark a post as “Old” if it’s been processed before or lacks a post ID.
Model Choice
The workflow uses gpt-5-mini through the lmChatOpenAi node, paired with a LangChain Agent node for classification.
Memory
Persistent memory is externalized via Airtable. Each post’s ID is stored and checked so the agent won’t reprocess duplicates. There’s no native conversation memory beyond this.
Bright Data Verified Node
The workflow begins by pulling Elon Musk related URLs from an RSS feed, but raw RSS data is too shallow to understand the real substance of a post. That’s where Bright Data shines: its scraper transforms a bare link into a rich, structured dataset containing the full post details, quotes, bios, and parent context.
This enriched view gives the AI agent exactly what it needs to make accurate classifications, deciding whether the content is about Tesla, SpaceX, Neuralink, BoringCompany, X, or xAI.
Without Bright Data, the agent would be guessing in the dark. With Bright Data, it has a spotlight on the full conversation, enabling precise AI-driven insights that are stored and tracked in Airtable for a living dashboard.
Journey
This project began as an experiment to see how much Elon Musk was sleeping, based on his first and last posts each day. But the real insight came from what companies he was actively focusing on. By classifying each post, the dashboard now reveals Musk’s shifting attention across his empire, offering a signal of where new innovations, product launches, or investments may emerge next.
More About Us
If you’re curious about how n8n can streamline business processes, happy to share what I’ve learned.
LinkedIn: https://www.linkedin.com/in/willcarlson1/
Top comments (0)