DEV Community

Cover image for OpinionFlow – Real-Time Review Intelligence with Bright Data, Gemini 2.0 & Pinecone

OpinionFlow – Real-Time Review Intelligence with Bright Data, Gemini 2.0 & Pinecone

Shivansh Singh on May 26, 2025

This is a submission for the Bright Data AI Web Access Hackathon 🔥 What I Built OpinionFlow helps users skip the endless scroll. It'...
Collapse
 
dotallio profile image
Dotallio •

Super cool seeing live reviews merged with quick AI insights like this. Any plans to add more stores or deeper personalization next?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Thank you so much for your comment. Yes I am thinking to add more stores and do deeper personalizations in this project. This project really resonates with me.

Collapse
 
divyanshsinghh profile image
Divyansh Singh •

Top-notch work! Sir

Collapse
 
divyanshsinghh profile image
Info Comment hidden by post author - thread only accessible via permalink
Divyansh Singh •

Thanks for sharing this sir!
Very great work❣️

Collapse
 
shagun_singh_ac41877ec7d8 profile image
Shagun Singh •

Great work as always!!

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Thanks for always showing up and supporting. Means a lot!

Collapse
 
scott_1209 profile image
Scott Peralta •

Fabulous this is! Such a life saver. Good work!

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Thank you so much! Glad to hear it's helpful to you. Let me know if you try it out!

Collapse
 
jennysa21 profile image
Jenny Sa •

Good work

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Thank you

Collapse
 
daliudi profile image
Dalimin Iswahyudi •

Honestly didn’t think something like this could be built in a hackathon timeframe. Hats off!

Collapse
 
bahmansimonn profile image
Bahman Simon •

Great work shivansh, thanks for sharing this

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Really appreciate that - it was a fun challenge putting all together.

Collapse
 
nathan_tarbert profile image
Nathan Tarbert •

pretty cool seeing tools get tied together like this - makes me curious, you think momentum on stuff like this depends more on habits or just chasing little wins day by day?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Thanks! Honestly, I think it's a mix of both - I definitely chase small wins to stay motivated, but a lot of it also just comes from long-term habits. I've been coding since I was a kid, so some of that momentum is just muscle memory at this point.

Collapse
 
nitya_bhardwaj_7189adc360 profile image
Nitya Bhardwaj •

This is such a cool use of Ai and web scrapping.. something like this can save so much time and efforts of users. Great stuff man!

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

I'm glad you liked it! Thanks for commenting.

Collapse
 
pedrorez profile image
Pedro Rodriguez •

What stood out to me is how you have aligned semantic caching with product discovery - it felt like the kind of detail that only comes from actually building and testing products deeply.

Thank you again!

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Woow, appreciate that insight - yes caching was the trickiest part in this. Took a few iterations to get the key structure right. Pinecone is great too

Collapse
 
tomasreuteraf profile image
Tomas Reuter •

Would love to see multilingual support in future, you are currently looking for amazon.com but they have different variants for different countries. So maybe you can try to look at or detect user's location and then connect to amazon or walmart. BTW! really great work.

Collapse
 
matilova profile image
Matilda Sobotková •

Was it tough to parse the HTML across different stores like Walmart and Amazon?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

100%. Every store has different DOMs, lazy loading, and anti-bot tricks. The use of browser api, and other servies from Brightdata made it easy to extract information.

Collapse
 
yixuanhe12 profile image
Yixuan He •

Sometimes the website shows, error loading analysis

Collapse
 
bergnaumdallas241 profile image
力 叶 •

Happened with me too! But then I guess now it's working.

Collapse
 
nancyalave213 profile image
Nancy Alave •

This is incredibly helpful for comparison shoppers like me! Any plans to add Flipkart or BestBuy next?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

The scraping structure is modular, so Flipkart and BestBuy are 90% ready - just need to fine-tune HTML selectors and test a few edge cases.

Collapse
 
philipposmykstudio profile image
Philip M Posmyk •

Tried searching for 'MacBook Air' — worked beautifully. Would be great to export reviews too!

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Great to hear that! Expoert is a solid idea - CSV or PDF maybe? I'll see how I can fit it into the next sprint.

Collapse
 
bergnaumdallas241 profile image
力 叶 •

Would love to see how it handles products with thousands of variants. Great job Shivansh!

Collapse
 
shivanshsinghh profile image
Shivansh Singh • • Edited

That's definitely a trick part! Right now, it clusters reviews at the product level, but doesn't differentiate by variant (like size or color).

Collapse
 
estevale profile image
Estêvão Delvalle •

Maybe in future versions, you could allow users to contribute their own reviews and see how Gemini classifies them?”

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Ooh I really like that! Like a sandbox mode for testing your own feedback - thanks for the idea, bookmarking it.

Collapse
 
victorson12 profile image
Victor Svensson •

Brooo this is insane 🔥🔥 I remember when you were just sketching this out — now it’s a full-blown AI system with caching and scraping and everything. Let’s gooo!

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Man that means a ton! You've seen the whole journey, from doodles to delivery. Appreciate you cheering me on the way!

Collapse
 
suleymurk profile image
Süleyman Öztürk •

Just used the live demo — the way it breaks down pros/cons and sentiment across stores is honestly more helpful than most YouTube review videos lol.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Hahah I'll take that as a big win. Glad you liked it!

Collapse
 
fletcll profile image
Fletcher Mitchell •

One suggestion: showing the last scraped timestamp for each store would build a lot of user trust. Just a little ‘Fresh as of…’ badge maybe?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Love this and totally agree. Adding a "Last updated: X mins ago" badge per store is actually super simple to implement with current cache structure. Will try to ship that next !

Collapse
 
toniar914 profile image
Toni Raić-Sudar •

That semantic caching with Hugging Face is super interesting. Do you embed each review separately or batch them by product?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Great question - I batch them by product for now, since it makes Gemini's job easier too. Thinking of switching to per-review embedding for more granular analysis later on.

Collapse
 
lucasalert profile image
Lucas Lambert •

Loved the demo! Would be cool to know how Pinecone handles paraphrased or fuzzy queries. Does it match on semantic similarity only?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Yes exactly - it works on embeddings, so even if oyu say "best wireless earbuds" and someone says "top bluetooth headphones", it knows to match based on meaning, not words. Super powerful!

Collapse
 
tugimaon profile image
Tugiman Tampubolon •

Quick question: does the Gemini analysis handle multilingual reviews? Or is it limited to English for now?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Currently it's mostly tuned for English, though Gemini does handle multilingual reasonably well. Planning to test with Hindi and Spanish next to see how it holds up.

Collapse
 
joschchta profile image
Joshua Albrecht •

One idea: could be awesome to let users upvote or bookmark the most relevant insights per product. Adds a human layer on top of AI

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Yes! That would make it more community driven and help get most out of it.

Collapse
 
chokhchwy profile image
เขมจิรา เกตุอารี •

Absolutely loved the clarity of the summaries — way better than skimming 100+ reviews. You’ve nailed both utility and presentation

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Thanks so much - took a tweaking to make Gemini return clean and accurate summaries. Glad it's working as intended!

Collapse
 
ivainmarin profile image
Ivan Marin •

This is the kind of thing I’d actually use before buying anything online. Let me know when you launch a full version!

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

That made my day! I;m polishing the UI and will definitely drop an update once it's product-ready.

Collapse
 
oxinoer profile image
Охинбархаг Doe •

Хөөе энэ үнэхээр гайхалтай.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Баярлалаа! Thank you so much — appreciate the love!

Collapse
 
backslash_flutter_032b58a profile image
BackSlash Flutter •

Great work

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Thank you! Really appreciate your time to check this out

Collapse
 
valbefa profile image
Valbona Sefa •

One thing I’d love to see is a timeline feature — like how sentiment shifts over time for a product as updates roll out or versions change.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Yes yes yes — time-based review analysis is one of my favorite ideas. Currently the backend already stores timestamps per review, so i can do sentiment shifts over weeks/months. Thanks for commenting

Collapse
 
andrsov profile image
Andres Kuznetsov •

Would it be possible to let users upload a product URL from any store and get analysis instantly? That would make this even more flexible.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Yes! I've already built in support for direct URLs. Would be live soon!

Collapse
 
pannaantal profile image
Panna Antal •

I didn’t even know Pinecone could be used like this. Thanks for showcasing how semantic search can power something practical like this.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Absolutely! That's what I was aiming for - real-world usage that just goes beyond the demos. Happy you found it interesting!

Collapse
 
antonore profile image
Antonio Fiore •

Honestly surprised at how polished this is. The backend flow makes sense and the front-end is clean too. Respect.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

That means a lot - thank you! It took a lot of iterations to get it this clean. Happy the backend/frontend flow felt smooth to you.

Collapse
 
johnmohar profile image
John Montahar •

Great work. I also applied to this hackathon, but couldn't finalize the end product. Great to see how you finalized this project.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Totally get that - sometimes it just doesn't click in time. Hope you jump back into the next one!

Collapse
 
amit_kashyap_d50761cebf2f profile image
Amit Kashyap •

How you integrated Amazon review scrapping in this? BTW project looks solid.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

You can find Amazon Review extractors in Bright Data - Web Scraper for Amazon

Collapse
 
veninov profile image
Вениамин Смирнов •

Оцените пошаговое руководство. Пользовательский интерфейс интуитивно понятен и не кажется перегруженным.

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Большое спасибо! Appreciate the feedback — I worked hard to keep the UI clean and beginner-friendly.

Collapse
 
simonendt profile image
Simone Brandt •

Curious how LangChain fits into the final RAG flow — are you using custom retrievers?

Collapse
 
shivanshsinghh profile image
Shivansh Singh •

Yes- I'm using Langchain to orchestrate the retrieval and prompting. The retriever pulls from Pinecone using cosine similarity and then fiilters based on metadata like store+timestamp before the Gemini call.

Collapse
 
mathias95 profile image
Cyril de Cock •

Just saw your linkedin post, and wanted to really thank you for this creation.

Collapse
 
elihaconrleis profile image
Eliah Cornelis •

Question: How do you manage inconsistencies in review formats between stores? I imagine Amazon and Walmart have very different structures.

Collapse
 
sofiardmyimage profile image
Sofia Meldgaard •

This feels like ChatGPT with a memory — but for ecommerce reviews. Great job!

Collapse
 
renesimek profile image
René Šimek •

Could be intereting to integrate price tracking next. This way intelligence + price tracking would be really good.

Collapse
 
michakaalakoswa profile image
Michalina Laskowska •

The way it summarizes real user sentiment into a one-liner is impressive. Curious — how long does it take from query to final answer?

Collapse
 
marianad190 profile image
Mariana Silva •

Great project, wishing you luck for this hackathon!

Collapse
 
jorgevacia profile image
Jorge Valencia •

Super clean interface - loved it

Some comments have been hidden by the post's author - find out more