DEV Community

Cover image for Creating a website aggregator with ChatGPT, React, and Node.js 🚀

Creating a website aggregator with ChatGPT, React, and Node.js 🚀

Nevo David on January 11, 2023

A website aggregator is a website that collects data from other websites across the internet and puts the information in one place where visitors c...
Collapse
 
nevodavid profile image
Nevo David • Edited

Hi Friends!
If you want to know exactly when I post, just register to my newsletter here

Collapse
 
sumitsaurabh927 profile image
Sumit Saurabh

Very well explained! 👏👏👏

Collapse
 
nevodavid profile image
Nevo David

Thank you Sumit 🤗
Whatsupppp

Collapse
 
sumitsaurabh927 profile image
Sumit Saurabh

I love the depth you cover in every article you post. That's what's up!!!

Collapse
 
harmonygrams profile image
Harmony

I just noticed that puppeteer doesn't work for me.
I've tried several times. It seems it doesn't have the capability to
scrape some websties.

Collapse
 
nevodavid profile image
Nevo David

Shouldn’t be a problem, maybe you are on headless mode?

Collapse
 
harmonygrams profile image
Harmony

What do you mean by headless mode?

Collapse
 
optimisedu profile image
optimisedu

Wow. You have created blueprints / boilerplate for a monster. Great article, summery and boilerplate =)

Collapse
 
nevodavid profile image
Nevo David

Thank you 🤩

Collapse
 
mezieb profile image
Okoro chimezie bright

Well done thanks for the update👍

Collapse
 
nevodavid profile image
Nevo David

You are welcome 🤗

Collapse
 
elhamnajeebullah profile image
Elham Najeebullah

I am only having one problem, everytime i submit the add website form, it open a new tab and take me to the openai site to login first. Did anyone had this problem and is there a way to handle the login process within the code before interacting with the website's content?

Collapse
 
kerimedeiros profile image
Keri Medeiros

Experiencing same issue on my end.

Collapse
 
sip profile image
Dom Sipowicz • Edited

I have a genuine question. Is there a reason to use ChatGPT over OpenAI's text-davincii-text or other OpenAI models? I know everyone use the ChatGPT (check the chart) but it's faster and more "the right way" to use directly the text/code models to perform those tasks.

Collapse
 
nevodavid profile image
Nevo David

Yes there is.
OpenAI AI uses GPT3,
Chat GPT uses a more advanced model of GPT3.5

Collapse
 
sip profile image
Dom Sipowicz

Fair enough. Also based on my own testing, text-davinci-003 yielded similar and sometimes more accurate results than ChatGPT in some cases.

Collapse
 
lorenz1989 profile image
lorenz1989

A group of students from a renowned university have researched and combined ChatGPT with search tools such as Google, Bing, and DuckDuckGo. The results exceeded expectations.
Just log in to your OpenAI account to use it.
Let’s try it at: chrome.google.com/webstore/detail/...
Source: twitter.com/DataChaz/status/160818...

Collapse
 
matija2209 profile image
matija2209

I'm building a tool that requires scraping product listings. I mostly rely on structured data for price, reviews, sku, stock, etc. Do you think any of the OpenAI products could parse prices/reviews where there is no structured data? Thanks!

Collapse
 
ajaxstardust profile image
ajaxStardust

i'm looking forward to trying this!

Collapse
 
limjinda profile image
Jirayu Limjinda

Nice template. I should try this weekend!

Collapse
 
artborovik profile image
Arborovik • Edited

This step-by-step guide makes it simple to follow along and comprehend the process. ChatGPT adds an intriguing element to the project, and I can see it being beneficial in a variety of applications.

Collapse
 
pavanbelagatti profile image
Pavan Belagatti

Good one. I love trying such applications

Collapse
 
nevodavid profile image
Nevo David

Thank you 🤩