DEV Community

Jordan Hansen
Jordan Hansen

Posted on • Originally published at javascriptwebscrapingguy.com on

Jordan Scrapes California, implemented into AWS Lambda and DynamoDB

#webscraping #aws #dynamodb #lambda

Part two of the California Secretary of State business scraper. This takes the step to integrate it into AWS Lambda and DynamoDB.

I use 7zip to zip the package and upload it to Lambda. I had to add 7zip to the PATH but besides that, all you have to use is this script in your package.json (found here):

  "scripts": {
    "zip": "tsc && 7z a -r function.zip ./dist/* node_modules/",
    "sendToLambda": "npm run zip && aws lambda update-function-code --function-name oregon --zip-file fileb://function.zip"
  },
Enter fullscreen mode Exit fullscreen mode

Looking for business leads?

Using the techniques talked about here at javascriptwebscrapingguy.com, we’ve been able to launch a way to access awesome web data. Learn more at Cobalt Intelligence!

The post Jordan Scrapes California, implemented into AWS Lambda and DynamoDB appeared first on Javascript Web Scraping Guy.

profile
Postmark
 Promoted

Speedy emails, satisfied customers

Postmark Image

Are delayed transactional emails costing you user satisfaction? Postmark delivers your emails almost instantly, keeping your customers happy and connected.

Sign up

Top comments (0)

profile
Coherence
 Promoted

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

Read next

bhaveshgohel profile image

🚀 Key Takeaways from Dr. Werner Vogels' Keynote at AWS re:Invent 2024 🌍

Bhavesh Gohel -

jatinmehrotra profile image

EKS Auto Mode Arrives in Terraform – Simplify Kubernetes Today

Jatin Mehrotra -

yokwejuste profile image

Day 03: Deploying Basic Infrastructure with Terraform

Steve Yonkeu -

rogerchi profile image

Practical DynamoDB - Locking Reads

Roger Chi -