Amazon S3: Amazon Simple Storage Service

Overview

• Amazon S3 is an object storage service offering scalability, data availability, security, and performance.
• Used for various use cases including data lakes, websites, mobile apps, backup and restore, big data analytics, etc.
• Offers management features for data organization and compliance.

Key Features

Storage Classes

• S3 Standard & S3 Express One Zone: For frequently accessed data.
• S3 Standard-IA & S3 One Zone-IA: For infrequently accessed data.
• S3 Glacier Classes: For archival data at low cost.
• S3 Intelligent-Tiering: Automatically moves data between access tiers based on usage.

Storage Management

• S3 Lifecycle: Manage objects and transition them through different storage classes.
• S3 Object Lock: Prevents deletion/overwriting, useful for compliance.
• S3 Replication: Replicates data across buckets for various use cases.
• S3 Batch Operations: Manages large-scale operations on multiple objects.

Access Management and Security

• S3 Block Public Access: Controls public access settings for buckets and objects.
• AWS IAM: Provides permission control for S3 resources.
• Bucket Policies & ACLs: Used for setting access permissions.
• S3 Access Points: Manage data access with named network endpoints.
• S3 Object Ownership: Simplifies access management by disabling ACLs.

Data Processing

• S3 Object Lambda: Allows custom coding on data retrieval requests.
• Event Notifications: Automate workflows on changes to S3 resources.

Logging and Monitoring

• Amazon CloudWatch & AWS CloudTrail: Monitor S3 usage and track API calls.
• Server Access Logging & AWS Trusted Advisor: Provides access logs and optimization checks.

Analytics and Insights

• Amazon S3 Storage Lens: Provides metrics and insights into storage usage.
• Storage Class Analysis & S3 Inventory: Analyzes access patterns and audits objects.

Data Consistency Model

• Provides strong read-after-write consistency for operations on objects.
• Ensures atomic updates and eventual consistency for bucket configurations.

How S3 Works

• Objects & Buckets: Data stored as objects within buckets.
• Keys: Unique identifiers for objects within buckets.
• S3 Versioning: Maintains multiple versions of objects for recovery.
• Access Control: Managed via bucket policies, IAM policies, ACLs.

Accessing Amazon S3

• AWS Management Console: Web-based interface for managing S3.
• AWS CLI & SDKs: Command-line tools and libraries for programmatic access.
• Amazon S3 REST API: HTTP-based API for interacting with S3.

Pricing

• Pay-as-you-go Model: Charges based on actual usage, no hidden fees.
• Free Tier: Offers free usage for new customers.

PCI DSS Compliance

• Amazon S3 supports PCI DSS compliance for processing and storing credit card data.