DEV Community: Raktim Yoddha

AWS S3?

Raktim Yoddha — Sat, 16 Jul 2022 09:48:26 +0000

What is AWS S3?

Amazon S3 (Simple Storage Service) provides object storage, which is built for storing and recovering any amount of information or data from anywhere over the internet. It provides this storage through a web services interface. While designed for developers for easier web-scale computing, it provides 99.999999999 percent durability and 99.99 percent availability of objects. It can also store computer files up to 5 terabytes in size.

AWS S3 Benefits

Durability : S3 provides 99.999999999 percent durability.
Security : S3 offers an impressive range of access management tools and encryption features that provide top-notch security.
Low cost : S3 lets you store data in a range of “storage classes.” These classes are based on the frequency and immediacy you require in accessing files.
Scalability : S3 charges you only for what resources you actually use, and there are no hidden fees or overage charges. You can scale your storage resources to easily meet your organization’s ever-changing demands.
Availability : S3 offers 99.99 percent availability of objects
Flexibility : S3 is ideal for a wide range of uses like data storage, data backup, software delivery, data archiving, disaster recovery, website hosting, mobile applications, IoT devices, and much more.
Simple data transfer : You don’t have to be an IT genius to execute data transfers on S3. The service revolves around simplicity and ease of use.

AWS Buckets and Objects

An object consists of data, key (assigned name), and metadata. A bucket is used to store objects. When data is added to a bucket*8, Amazon S3 creates a unique version ID and allocates it to the **object.

How Does Amazon S3 work?

First off, a user creates a bucket. When this bucket is created, the user will specify the region in which the bucket is deployed. Later, when files are uploaded to the bucket, the user will determine the type of S3 storage class to be used for those specific objects. After this, users can define features to the bucket, such as bucket policy, lifecycle policies, versioning control, etc.

Access Files from AWS S3 Bucket Using NodeJs

Raktim Yoddha — Sat, 16 Jul 2022 09:19:53 +0000

Here we will learn how to upload , download and delete
files in AWS S3 bucket using NodeJs

Step 1: Create a AWS account

First we need to create a AWS account if we don't have one
You may create a free tier account but you need to fill your card details there

Step 2: Initialize the Project

Create a folder lets say 's3' in your desktop or wherever you
want
Open the terminal and direct their using cd command
- cd desktop
- cd s3

Now add npm json file in it
- npm init -y

create a file 'app.js' in the folder s3

Step 3: Installing the required dependencies

Install express, aws-sdk and multer in your folder i.e. s3
- npm install express aws-sdk multer multer-s3

Step 4: S3 bucket setup

Open the AWS console
Now Search S3 there and then open S3
Click on Create bucket option
Set name and region there and unselect☑️ 'block all public access'
select✅ 'Block public access to buckets and objects granted through new public bucket or access point policies'
and 'Block public and cross-account access to buckets and objects through any public bucket or access point policies'
Click on create bucket

congratulations your bucket is created

Step 5: Create AWS Credentials

First click on 'Innominds'
Then click on 'My security credentials'
Then click on the 'Access key' and then 'Create New Access Key'
You will get your access key there

Step 6: Create .env file

Create a .env file in your s3 folder
Inside .env file enter:-
- ACCESS_KEY = (your access key)
- ACCESS_SECRET = (your secret access key)
- REGION = (region of your bucket)
- BUCKET = (name of your bucket)

Step 7: Create a express server

create express server inside the file 'app.js'
Don't forget to add .env file to your 's3' folder
-npm i dotenv
Declare all the previously mentioned libraries like aws-sdk, multer, multer-s3 in your express server

Step 8: Use muller with aws-sdk to acccess the file

Here is one standard Example for Express server:-

require("dotenv").config()

const express = require('express')

const app = express();

app.listen(3001);

const aws = require('aws-sdk')
const multer = require('multer')
const multerS3 = require('multer-s3');

aws.config.update({
secretAccessKey: process.env.ACCESS_SECRET,
accessKeyId: process.env.ACCESS_KEY,
region: process.env.REGION,

});
const BUCKET = process.env.BUCKET
const s3 = new aws.S3();

const upload = multer({
storage: multerS3({
s3: s3,
acl: "public-read",
bucket: BUCKET,
key: function (req, file, cb) {
console.log(file);
cb(null, file.originalname)
}
})
})

app.post('/upload', upload.single('file'), async function (req, res, next) {

res.send('Successfully uploaded ' + req.file.location + ' location!')

})

app.get("/list", async (req, res) => {

let r = await s3.listObjectsV2({ Bucket: BUCKET }).promise();
let x = r.Contents.map(item => item.Key);
res.send(x)

})

app.get("/download/:filename", async (req, res) => {
const filename = req.params.filename
let x = await s3.getObject({ Bucket: BUCKET, Key: filename }).promise();
res.send(x.Body)
})

app.delete("/delete/:filename", async (req, res) => {
const filename = req.params.filename
await s3.deleteObject({ Bucket: BUCKET, Key: filename }).promise();
res.send("File Deleted Successfully")

})

Amazon Web Services(AWS)

Raktim Yoddha — Fri, 15 Jul 2022 17:31:10 +0000

What is AWS?

You might be familiar with the term AWS? But actually bit confused what actually it is?

Amazon Web Services aka AWS is a secure cloud services platform offering nearly everything businesses need to build sophisticated applications with flexibility, scalability, and reliability. It is a “pay-as-you-go” billing model with no upfront or capital costs.

It's basically a cloud provider–from infrastructure technologies like computing, storage, and databases–to emerging technologies, such as ML and AI, data lakes and analytics, and the IoT.

Why AWS is so successful?

In spite of having so many competitors like Azure, Google Cloud, IBM Cloud, Oracle Cloud, and many more still AWS is very popular because:-

Security :- AWS encrypt the data, offering end-to-end privacy and storage. AWS supports 80+ security standards and compliance certifications, more than 100 AWS services that are storing customer data offer the ability to encrypt that data, and all of this is backed by a deep set of cloud security tools, with 200+ security, compliance, and governance services and features.
Experience :- Developers can rely on Amazon’s established processes. Their tools, techniques and suggested best practices are built upon years of experience.
Flexibility :- There is great flexibility in AWS, allowing developers to select the OS language and database.
Ease of Use :- AWS is easy to use. Developers can swiftly deploy and host applications, build new applications or migrate existing applications.
Scalability :- Applications can be easily scaled up or down depending on user requirements.
Cost savings - Companies only pay for the computing power, storage and resources used, with no long-term commitments.

Commonly Used Services Provided by AWS

Amazon EC2 ;- Providing secure compute capacity in the cloud, EC2 is resettable based on the user’s requirements. For instance, in a scenario in which web traffic varies, this service can expand its environment, behind the scenes, to three instances when required and then shrink to just one resource when load decreases.
Amazon Elastic Beanstalk :- Made with a number of programming languages, this service helps scale and deploy web applications. Simply upload the code and Elastic Beanstalk automatically handles the deployment from capacity provisioning to load balancing to auto-scaling to application health monitoring.
Amazon Lightsail - Simple to launch and manage, Amazon Lightsail is a virtual private server and includes everything needed to quickly launch a project on a virtual machine, like SSD-based storage, tools for data transfer, DNS management and a static IP.
Amazon Lambda - Lambda allows companies to run code with no need for provisioning and managing servers. It scales automatically from a few requests per day to thousands per second. Companies only pay for the compute times used; there is no charge when the code is not running.

AWS Storage Services

Amazon S3 :- S3 can store and retrieve data from anywhere -- websites, mobile apps, IoT sensors and the like. It offers data management flexibility, durability and security for internet storage.
Amazon Glacier :- A cloud storage service for archiving data and long-term backups, Glacier is a low-cost, highly secure option.
Amazon Elastic Block Store (EBS) :- EBS provides block store volumes for instances of EC2 and is a reliable storage volume that can be attached to any running instance in the same availability zone.

AWS Databases

Amazon RDS :- Easing the process of setting up, operating and scaling a relational database in the cloud, Amazon RDS provides cost-efficient and resizable capacity while automating time-consuming administrative tasks such as hardware database setup, patching and backups. The service is optimized for memory performance and input/output operations.
Amazon Redshift :- This data warehousing service enables users to analyze data using SQL and other business intelligence tools. It can run complex queries against terabytes of structured data and receive results in seconds.

Hope this will help...