How to scrape google search results in Google sheets ?

I had written this original article on my website aozata.com . Wanted to share this method with the dev community here at Dev.to.

Here are steps to scrape google search results in google sheets. It only gets 10 results per search query.

1. Create a google sheet in your google drive.
2. Create a google custom search engine.
3. Enable search the entire web.
4. Copy your google custom search engine id.
5. Get your google custom search api key from here
6. Formulate your api key in this format.

https://www.googleapis.com/customsearch/v1?key={YOUR_API_KEY}&cx={CUSTOM_SEARCH_ENGINE_ID}&q={KEYWORD}

key is your API key,
cx is your google custom search id.

1. In your google sheets, go to tools-> script editor-> paste the following code->save the file as ImportJSON.gs. The ImportJSON.gs can be downloaded from here https://www.aozata.com/importjson-gs/

2. Enter the cx, key, search query (q), API URL in different cells.

3. Use the concatenate function to join all these 4 variables to get your final API URL. For example

=concatenate(D4,D2,"&cx=",D1,"&q=",D3)

1. Use the ImportJSON function to import the google search results. for example to get the title of the search results

=ImportJSON($D$5,"/items/title","noHeaders")

You can buy this google sheet from here.