DEV Community: krish

AWS DataSync

krish — Thu, 19 Nov 2020 04:40:23 +0000

AWS DataSync
Day 3
AWS DataSync, the word itself described as data synchronization in AWS, will be the subject we will be discussing. The data-transfer service that simplifies , easier and automates for replication of data between On-premises and AWS storage over internet or AWS direct.

How it works - Installing the AWS DataSync Agent on server to connect the file system to AWS and write data from AWS. Network transfers accelerates the encrypted data over WAN areas. It has high protection connecting with the storage in AWS services like S3 Bucket, EFS , Fsx on windows servers.
Overview
Helps in large amount of data transfer from on-premises to AWS.
Transfer files with NFS and SMB compatible file system.
Installing the DataSync Agent to start the replication, it can be maintained hourly, daily or weekly.

Use Cases
Data transfer can be made secure and reliable can be done by attaching the IAM roles to the AWS.
It helps in the reduction of operation data transfer cost, pay as per Giga-pricing of DataSync.

AWS S3

krish — Wed, 18 Nov 2020 05:24:14 +0000

Topic - AWS Cloud Services

AWS S3

Day 2

Overview about S3 Bucket

S3 Bucket — Simple Storage Service:

Image for post
sample image for S3 bucket
What is S3

S3 provides any organization or group with secure, durable and high scalable object storage. It is easy to store and retrieve any amount of data from any location, you can store unlimited amount of data. The file size need to be 0 Byte to 5 TB.

Why S3

It is safe and secure to store files in the form of objects.
It is compatible with multiple devices like laptops, mobile devices, etc.
It can be restrict the access from users by attaching the permissions in policy.
It is easy to identify the bucket because they are universal namespace.
The way you can store objects into S3 bucket is by upload the object, when operation is successful it gives you a code of HTTP 200.
Objects inside the S3 files

Key ( Name used to pass the file to identify).
Value ( Address to find the file).
Metadata( Data about data of objects for example raw data).
Version ID ( versioning attached to bucket).
Sub-resources -> Access Control list , Torrents ( kind of access permissions).
Success Rate for S3 buckets standard

Build for 99.99% of availability for S3 platform.
Amazon guarantees (11*9's)% of durability for storage information.
Amazon guarantees 99.9% of availability.
Features

Tiered storage availability — different level of uploading and storing the objects in S3 buckets.
Life cycle management -> which helps to upload the content in S3 bucket to S3 glacier after certain period of time.
S3 encryption helps to encrypt the content from the outside of the world, which means no one can view the content.
MFA — multi factor authentication can be set up for deletion of objects.
Cross-region replication, you can use the same bucket in multiple regions.
S3 Glacier — It is secure , durable and low-cost storage class, the amount of storage charges will less than storage on-premisis. The retrieval period of objects will be from minutes to hours depending on storage.

S3 Glacier deep archive- It is Amazon S3’s lowest-cost storage class where the retrieval period will be 12 hours in acceptable.

AWS Cloud Services

krish — Wed, 11 Nov 2020 05:19:36 +0000

Topic - AWS Cloud Services

A little brief about the AWS cloud - Amazon Web Services (AWS) is a cloud computing platform provided by Amazon. AWS services can offer an organization tools such as database storage, compute power, content delivery, and other user-friendly functionality services to help businesses grow and perform better.

Planning to cover most of the AWS topics which help for certification and daily usage in the organization. We will be discussing the first topic as the IAM service in AWS services.

IAM - Identity and Access Management - It manages the users and their level of access to the AWS Console.

Features -

Global access control of AWS.
Shared access to the AWS account.
Granular Permissions.
Identity Federation ( for example Active Directory Service, Facebook, Linkedin, etc. Platforms).
MFA - Multi-Factor Authenticator ( Use Google Authenticator for accessing the AWS as the second step for logging).
Provide temporary access for users and services where it is necessary.
Password rotation policy (Setting the rotation of password, conditions for a password for example string, char, num, etc).
Integrates with AWS different Services ( for example S3 Bucket, EC2 instance, Lambda, Fargate, etc).
Supports PCI DSS compliance ( Payment card industry for data storage standards) - It means helps to securely store credit cards and bank account of information.

The terminology used in the IAM -

Users - It lists the people in the organization.
Groups - Multiple users can be inherited into the group and can pass the same permissions to the users assigned to the group.
Policy - It is being defined in the format called JSON. Where we can customize the policy and gives permission as User/Role/Group.
Roles - It is created to assign the AWS resources. (for example S3 bucket, EC2 instance, etc).

Important Information regarding IAM -

IAM is universal for the AWS account.
Root account is the admin account created at the initial launch of the AWS.
Good practice to maintain MFA to the AWS account.