The latest articles on DEV Community by Shivansh Singh (@shivanshsinghh). https://dev.to/shivanshsinghh https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F1399391%2F18c222e1-ab49-4409-b4a7-3eb32563c73c.png https://dev.to/shivanshsinghh en Shivansh Singh Mon, 26 May 2025 05:34:14 +0000 https://dev.to/shivanshsinghh/opinionflow-real-time-review-intelligence-with-bright-data-gemini-20-pinecone-2ec8 https://dev.to/shivanshsinghh/opinionflow-real-time-review-intelligence-with-bright-data-gemini-20-pinecone-2ec8 <p><em>This is a submission for the <a href="https://dev.to/challenges/brightdata-2025-05-07">Bright Data AI Web Access Hackathon</a></em></p> <h2> 🔥 What I Built </h2> <p><strong>OpinionFlow</strong> helps users skip the endless scroll. It's an AI-powered review assistant that:</p> <ul> <li>Crawls live product reviews from <strong>Amazon</strong> and <strong>Walmart</strong> using Bright Data MCP</li> <li>Summarizes insights using <strong>Gemini Flash</strong> </li> <li>Caches results semantically using <strong>Pinecone</strong> </li> <li>Lets users ask product-specific questions via <strong>LangChain</strong> </li> </ul> <blockquote> <p>Want to know if the AirPods Pro have battery issues? Just ask — you’ll get instant, evidence-backed answers.</p> </blockquote> <h2> 📌 Demo </h2> <ul> <li>🌐 <a href="https://opinionflowproject.netlify.app" rel="noopener noreferrer">Live App</a> </li> <li>💻 <a href="https://github.com/meshivanshsinghh/opinionflow" rel="noopener noreferrer">GitHub Repo</a> </li> <li>🎥 Loom Demo </li> </ul> <div> <iframe src="https://loom.com/embed/bcdb3c26a0024fb1b0504ec66df32cf8"> </iframe> </div> <h2> 🧠 How It Works </h2> <div class="table-wrapper-paragraph"><table> <thead> <tr> <th>Step</th> <th>Description</th> </tr> </thead> <tbody> <tr> <td>🔍 <strong>Search</strong> </td> <td>Users enter a query (e.g., "Noise Buds X Prime")</td> </tr> <tr> <td>📄 <strong>Crawl</strong> </td> <td>Bright Data scrapes live reviews from both stores</td> </tr> <tr> <td>✨ <strong>Summarize</strong> </td> <td>Gemini Flash extracts sentiment, pros/cons, and key specs</td> </tr> <tr> <td>🧠 <strong>Cache</strong> </td> <td>MiniLM embeddings stored in Pinecone to avoid repetition</td> </tr> <tr> <td>💬 <strong>Answer</strong> </td> <td>LangChain generates natural-language responses with citations</td> </tr> </tbody> </table></div> <p> <a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F4bv6bl8eh3esxwmt22x7.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F4bv6bl8eh3esxwmt22x7.png" width="800" alt="Product discovery UI"></a> </p> <h2> 🧩 Features at a Glance </h2> <div class="table-wrapper-paragraph"><table> <thead> <tr> <th>Feature</th> <th>Description</th> </tr> </thead> <tbody> <tr> <td>💬 <strong>Instant AI Answer Box</strong> </td> <td>Summary with links to real reviews</td> </tr> <tr> <td>👍 <strong>Top Pros / Cons</strong> </td> <td>Highlighted from verified buyers</td> </tr> <tr> <td>📊 <strong>Sentiment Comparison</strong> </td> <td>Side-by-side scores from Amazon &amp; Walmart</td> </tr> <tr> <td>🏷️ <strong>Aspect Mini-Charts</strong> </td> <td>Dynamic breakdowns: battery, comfort, etc.</td> </tr> <tr> <td>🧭 <strong>Multi-Store Tabs</strong> </td> <td>Compare similar SKUs across platforms</td> </tr> <tr> <td>🔎 <strong>Review Explorer</strong> </td> <td>Drill down into sources and keywords</td> </tr> </tbody> </table></div> <p> <a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F8yf7kx3ow4gevnjk2d1a.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F8yf7kx3ow4gevnjk2d1a.png" width="800" alt="Sentiment analysis"></a> </p> <h2> 🚀 Bright Data in Action </h2> <div class="table-wrapper-paragraph"><table> <thead> <tr> <th>MCP Tool</th> <th>Role</th> </tr> </thead> <tbody> <tr> <td><strong>SERP API</strong></td> <td>Fetches product listings via Google Search</td> </tr> <tr> <td><strong>Web Unlocker</strong></td> <td>Unblocks product pages seamlessly</td> </tr> <tr> <td><strong>Scraping Browser</strong></td> <td>Renders full review sections</td> </tr> <tr> <td><strong>Browser API + Playwright</strong></td> <td>Handles dynamic navigation like "See all reviews"</td> </tr> </tbody> </table></div> <blockquote> <p>Bright Data saved me dozens of hours — no captchas, no proxy headaches, just clean data.</p> </blockquote> <h2> 🧠 Architecture Overview </h2> <p> <a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fesi8377nmd5e7i6o2yud.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fesi8377nmd5e7i6o2yud.png" width="800" alt="System Architecture Diagram"></a> </p> <p>OpinionFlow is built with a <strong>modular microservice-style architecture</strong> with FastAPI as the core backend. Key flows include:</p> <ul> <li>Product discovery → via Bright Data SERP API</li> <li>Review scraping → using custom extractors</li> <li>Analysis → powered by Gemini Flash</li> <li>Semantic caching → via Pinecone vector search</li> <li>Natural Q&amp;A → powered by LangChain and Gemini</li> </ul> <h2> 🧰 Tech Stack </h2> <p><strong>FastAPI</strong>, <strong>React.js</strong>, <strong>Bright Data MCP</strong>, <strong>Gemini Flash</strong>, <strong>Pinecone</strong>, <strong>LangChain</strong>, <strong>HuggingFace MiniLM</strong>, <strong>Netlify</strong>, <strong>Cloud Run</strong></p> <h2> 🔮 What's Next </h2> <ul> <li>Add <strong>Target.com</strong> integration </li> <li>Launch a <strong>real-time price tracker</strong> </li> <li>Let users <strong>add their own reviews</strong> </li> <li>Enable <strong>Gemini-powered follow-ups</strong> in chat</li> </ul> <h2> 🙏 Thanks </h2> <p>Big thanks to <strong>Bright Data</strong> and <strong>DEV</strong> for the challenge. If you liked this project, consider checking out:</p> <p>🌟 <a href="https://github.com/luminati-io/brightdata-mcp" rel="noopener noreferrer">github.com/luminati-io/brightdata-mcp</a></p> <p>Built with ❤️ by <a href="https://dev.to/shivanshsinghh">@shivanshsinghh</a></p> <h2> 🏷️ Tags </h2> <p><code>#BrightData #Hackathon #AI #LLM #Gemini #LangChain #Ecommerce #ProductReviews #FastAPI #React #Pinecone #SemanticSearch</code></p> devchallenge brightdatachallenge ai webdata