DEV Community

Cover image for Module 7: Cloud Storage Overview
Eunice js
Eunice js

Posted on

Module 7: Cloud Storage Overview

Cloud storage is a foundational part of cloud computing, providing scalable and durable solutions for a wide range of data storage needs. AWS offers several storage options, each optimized for specific use cases and requirements. This article delves into key AWS storage services, including Amazon Elastic Block Store (EBS), Amazon Simple Storage Service (S3), Amazon Elastic File System (EFS), and Amazon S3 Glacier.

Amazon Elastic Block Store (EBS)

Amazon EBS provides persistent block storage for Amazon EC2 instances. Persistent storage refers to non-volatile storage that retains data even when the device is powered off. Each EBS volume is automatically replicated within its Availability Zone, ensuring high availability and durability.

Key Features of EBS:

  • Block-Level Storage: Enables modification of individual blocks rather than entire files, which makes it efficient for large file changes.
  • Snapshots: EBS snapshots are backups of volumes. The first snapshot is a baseline, while subsequent snapshots only capture changes. Snapshots can be shared or copied across regions for disaster recovery.
  • Encryption: Data is encrypted both at rest and in transit, enhancing security at no additional cost.
  • Elasticity: Volumes can be resized or converted between different storage types, such as HDD and SSD, offering flexibility.

EBS Pricing:

  • Storage: Charged based on provisioned GB per month.
  • IOPS: Costs depend on the provisioned IOPS and usage duration.
  • Snapshots: Charged based on the storage used for snapshots.
  • Data Transfer: Inbound transfers are free, but outbound transfers across regions incur charges.

Amazon Simple Storage Service (S3)

Amazon S3 is an object storage service designed for scalability, durability, and cost efficiency. Objects are stored in buckets, which are globally unique containers.

Key Features:

  • Virtually Unlimited Storage: Single objects can be as large as 5 TB.
  • High Durability: S3 is designed for 99.999999999% durability (11 nines).
  • Fine-Grained Access Control: Permissions can be managed using IAM policies, bucket policies, or object-level access controls.
  • Encryption: Data can be encrypted at rest using server-side encryption and in transit via HTTPS.

S3 Storage Classes:

Storage Class Features
S3 Standard High durability, availability, and performance for frequently accessed data.
S3 Intelligent-Tiering Automatically moves objects between tiers based on access patterns, optimizing cost.
S3 Standard-Infrequent Access (IA) Lower cost for data accessed less frequently but still needs rapid access.
S3 One Zone-IA Lower-cost storage in a single Availability Zone, ideal for secondary backups or easy-to-recreate data.
S3 Glacier Low-cost storage for archival with retrieval times ranging from minutes to hours.
S3 Glacier Deep Archive Lowest-cost storage class for long-term retention, with retrieval times within 12 hours.

Common Use Cases:

  • Backup and storage
  • Application and media hosting
  • Software delivery

Pricing:

  • Charged based on storage type, data transfer, and request operations (PUT, GET, etc.). Inbound transfers and transfers to Amazon CloudFront are free.

Amazon Elastic File System (EFS)

Amazon EFS provides scalable file storage that can be accessed by multiple EC2 instances simultaneously.

Features:

  • Shared File Storage: Designed for big data analytics, content management, and web serving.
  • Petabyte-Scale: Offers low-latency access to data.
  • Compatibility: Supports NFSv4 and works with all Linux-based AMIs for EC2.
  • Elastic Capacity: Automatically scales storage capacity.

Implementation Steps:

  1. Create EC2 resources and instances.
  2. Create an EFS file system and mount targets.
  3. Connect EC2 instances to the mount targets.

Amazon S3 Glacier

Amazon S3 Glacier is a low-cost, secure storage service for data archiving and long-term backups.

Key Features:

  • Durability: Data is stored across multiple Availability Zones.
  • Encryption: Uses AES-256 encryption for data at rest.
  • Flexible Retrieval Options:
    • Expedited: 1-5 minutes
    • Standard: 3-5 hours
    • Bulk: 5-12 hours

Common Use Cases:

  • Media asset archiving
  • Healthcare and regulatory data storage
  • Magnetic tape replacement

Security Features:

  • Access Control: Managed through IAM.
  • Data Encryption: AES-256 encryption ensures secure storage.
  • Key Management: Encryption keys are automatically managed.

Comparison of Amazon S3 and S3 Glacier

Feature Amazon S3 Amazon S3 Glacier
Data Volume No limit No limit
Latency Milliseconds Minutes to hours
Maximum Item Size 5 TB 40 TB
Cost Higher Lower
Retrieval Pricing Per request Per request + per GB

Server-Side Encryption

Amazon S3 and Glacier offer multiple encryption options:

  1. SSE-S3: Each object is encrypted with a unique key.
  2. SSE-C: Customers manage encryption keys.
  3. SSE-KMS: Combines secure hardware and software for key management.

CONCLUSION

AWS provides a broad spectrum of storage solutions designed to meet diverse needs, from real-time access to archival storage. Whether you need high-performance block storage, scalable file systems, or cost-effective object storage, AWS has a service tailored to your requirements.

Top comments (0)