DEV Community

asser dev
asser dev

Posted on

my BIG BRAIN solution

look I made my own website called

web explorer

which is still in hard early development but works uses GitHub pages and a bunch of resources to get a near infinite amount of websites (no ai websites)

it runs every hour using a crawler made with python with

1.screenshot system (using WordPress high res),

2.filter system (filters unpolite stuff I can't say here),

3.checking system (makes sure the website link is for all ages and works),

4.catch system (catches the main name of website, its description, the first time it was archived was when)

uses supabase in a delete cycle so it is FREE99

see the code here

made with sweaty human developer hands

Top comments (0)