DEV Community

Ali Zulfaqar
Ali Zulfaqar

Posted on

7 4 4 5 3

Bright Data Web Scraping Challenge

This is a submission for the Bright Data Web Scraping Challenge: Scrape Data from Complex, Interactive Websites

What I Built

I created a webpage that displays real-time cryptocurrency data scraped from CoinGecko using Bright Data. The webpage provides users with up-to-date information on various cryptocurrencies, including their prices, market caps, and trading volumes.

Demo

You can check out the live demo of the project here. Below are some screenshots of the webpage:

Screenshot 1

How I Used Bright Data

I scraped the data using JavaScript and created an Express.js API to handle the data. This API sends the scraped data to Supabase, a backend-as-a-service platform. The data is then displayed on a dashboard that pulls the information from Supabase. The scraping process runs at an interval of every 3 minutes to ensure the data is always up-to-date.

Team Submissions This project was a collaborative effort. Special thanks to muhdmokhtar for developing the dashboard.

Image of Datadog

How to Diagram Your Cloud Architecture

Cloud architecture diagrams provide critical visibility into the resources in your environment and how they’re connected. In our latest eBook, AWS Solution Architects Jason Mimick and James Wenzel walk through best practices on how to build effective and professional diagrams.

Download the Free eBook

Top comments (0)