Run batch jobs using AWS Batch

AWS Batch enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory optimized instances) based on the volume and specific resource requirements of the batch jobs submitted.

what is a batch job?

A batch job is a job with a start and end to it as opposed to a continuous job that runs 24X7

AWS batch features

1. Batch processing service at any scale.

2. It provision the right amount of EC2 instances or Spot instances for processing the batch job based on the volume and the requirements

3. You submit or schedule batch jobs and AWS manages the rest

4. There run as Docker images.

Use cases

1. Pulling data form somewhere at night

2. Backups at midnight

3. Financial data processing each day