DEV Community

Shivam
Shivam

Posted on

Rival Guru : Know realtime facts about your competitors.

#devchallenge #brightdatachallenge #ai #webdata

This is a submission for the Bright Data AI Web Access Hackathon

What I Built

Ever wondered what your competitors are up to right now? Rival Guru fetches real-time data about your website's competitors and presents it in a clean, easy-to-analyze table format. đź“Š

🔍 Key Features:

  • Live tracking of competitor websites
  • Instantly updated metrics like traffic, keywords, backlinks & more
  • Organized in a sortable, filterable table for fast comparison
  • Designed for marketers, SEO specialists, and digital strategists

Whether you're looking to stay ahead or find opportunities, this dashboard gives you the insights you need—when you need them.

Demo

Github Repo

GitHub logo shivamarora1 / competitor-analysis

Want to beat the competition? Start by understanding them.

Rival Guru

Want to beat the competition? Start by understanding them. This tool helps you analyze competitors in your market space, track their features, and identify opportunities for differentiation.

Overview

This project provides a Streamlit-based web application for tracking and analyzing competitors. It allows you to:

  • Compare competitor features side-by-side
  • Identify market gaps and opportunities
  • Generate insights based on collected data

This project uses Bright data browser api , so make sure you have account in bright data and created API_TOKEN and BROWSER_AUTH

Setup Instructions

Prerequisites

  • Python 3.8 or higher
  • Git

Installation

  1. Clone this repository

    git clone <repository-url>
cd competitor-analysis

  2. Create and activate a virtual environment

    python -m venv .venv
source .venv/bin/activate  # On Windows: .venv\Scripts\activate

  3. Install dependencies

    pip install -r requirements.txt

  4. Set up .env

API_TOKEN= 
WEB_UNLOCKER_ZONE= 
BROWSER_AUTH= 
OPENAI_API_KEY=
  1. Run backend server:
uvicorn app.main:app --host 0.0.0.0 --port 8000
  1. Change the backend url in .streamlit/secret.toml 
BACKEND_URL= "http://0.0.0.0:8000"
  1. Run the Streamlit app
…
View on GitHub

How I Used Bright Data's Infrastructure

I’ve been using Bright Data’s Browser API to extract valuable insights about competitor companies—and it’s been incredibly effective.

🔍 Here's how it works in my workflow:

  • I navigate to the target website whose competitors I want to analyze.
  • Using SimilarWeb, I gather detailed data on competitors, including traffic, engagement, and ranking.

The Browser API makes the entire process seamless by allowing interaction with the page just like a real user—no need to deal with complex selectors or HTML structures.

Performance Improvements

Working with the Bright Data MCP Browser API has significantly simplified my data extraction workflow. One standout feature? I no longer need to hunt for CSS selectors or HTML field names.

✨ Why it's a game-changer:

  • You can extract data directly using visible field names on the screen — no need to inspect the source code.
  • This means I can focus purely on the data I need, rather than the technical structure behind it.
  • The built-in captcha solving is incredibly efficient and saves tons of manual effort.

Thanks to this, my workflow is faster, cleaner, and more scalable — perfect for real-time competitor analysis and other dynamic use cases.

🧠 Highly recommend it for anyone looking to automate web intelligence without getting bogged down in front-end details.

Top comments (0)