Difference between revisions of "Amazon Simple Storage Service (S3)"
Jump to navigation
Jump to search
↑ https://docs.aws.amazon.com/cli/latest/reference/s3/cp.html
↑ https://docs.aws.amazon.com/cli/latest/reference/s3/mb.html
↑ https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-inventory.html
Line 11: | Line 11: | ||
== Amazon S3 Storage Classes == | == Amazon S3 Storage Classes == | ||
* Amazon S3 Standard is the default class. | * Amazon S3 Standard is the default class. | ||
− | * Amazon S3 Standard Infrequent Access (IA) is designed for less frequently accessed data. Typical use cases are backup and disaster recovery solutions. | + | * [[Amazon S3 Standard Infrequent Access (IA)]] is designed for less frequently accessed data. Typical use cases are backup and disaster recovery solutions. |
* Amazon S3 One Zone-Infrequent Access is designed for data that is not often needed but when required, needs to be accessed rapidly. Data is stored in one zone and if that zone is destroyed, all data is lost. | * Amazon S3 One Zone-Infrequent Access is designed for data that is not often needed but when required, needs to be accessed rapidly. Data is stored in one zone and if that zone is destroyed, all data is lost. | ||
* [[Amazon Glacier]] is designed for long-term storage of data that is infrequently accessed and where retrieval latency of minutes or hours is acceptable. "[[Glacier Deep Archive]]" is an alternative with a retrieval time of at least 12 hours, but 1/4th the price. It is intended as an alternative to magnetic tape libraries, and is designed for long term retention of data for 7 to 10 years. | * [[Amazon Glacier]] is designed for long-term storage of data that is infrequently accessed and where retrieval latency of minutes or hours is acceptable. "[[Glacier Deep Archive]]" is an alternative with a retrieval time of at least 12 hours, but 1/4th the price. It is intended as an alternative to magnetic tape libraries, and is designed for long term retention of data for 7 to 10 years. |
Revision as of 09:08, 2 March 2022
wikipedia:Amazon S3 (March 2006) or Amazon Simple Storage Service a service offered by Amazon Web Services (AWS) since 2006 that provides Object Storage through a web service interface or CLI.
- AWS free tier: 5 GB
Contents
Features
Amazon S3 Storage Classes
- Amazon S3 Standard is the default class.
- Amazon S3 Standard Infrequent Access (IA) is designed for less frequently accessed data. Typical use cases are backup and disaster recovery solutions.
- Amazon S3 One Zone-Infrequent Access is designed for data that is not often needed but when required, needs to be accessed rapidly. Data is stored in one zone and if that zone is destroyed, all data is lost.
- Amazon Glacier is designed for long-term storage of data that is infrequently accessed and where retrieval latency of minutes or hours is acceptable. "Glacier Deep Archive" is an alternative with a retrieval time of at least 12 hours, but 1/4th the price. It is intended as an alternative to magnetic tape libraries, and is designed for long term retention of data for 7 to 10 years.
Commands
See also: AWS Command Line Tool (CLI)
aws s3 cp
[1]aws s3 sync
aws s3 rm
aws s3 help
aws s3 mb
[2] (creates a bucket)aws s3 rb
aws s3 presign
https://docs.aws.amazon.com/cli/latest/reference/s3/
Amazon S3 logs
Amazon S3 allows users to enable or disable logging. If enabled, the logs are stored in Amazon S3 buckets which can then be analyzed. These logs contain useful information such as:
- Date and time of access to requested content
- Protocol used (HTTP, FTP, etc.)
- HTTP status codes
- Turnaround time
- HTTP request message
Encryption
Encryption (2017) is supported in AWS S3 (default Advanced Encryption Standard (AES) 256bit)
- In transit (SSL/TLS)
- At rest:
- Server Side Encryption (SSE):
- S3 Managed Keys (SSE-S3; 256bit);
- AWS Key Management Service, Managed Keys (SSE-KMS)
- Server Side Encryption with Customer Provided Keys (SSE-C)
- Client Side Encryption (user encypts data on their local machine and then upload to AWS S3)
Replication
Related terms
- Amazon EBS, Amazon EFS
- CloudBerry Explorer for Amazon S3
- Transmit 5
- Cyberduck
- s3fs-fuse
- AWS Storage Gateway
- Amazon Glacier
- Amazon S3 Cross-Region Replication (CRR)
- PrestoDB SQL engine
- AWS: 1.4 Choose appropriate resilient storage
- CloudFormation:
AWS::S3, AWS::S3::Bucket
- Amazon S3 Storage Lens
- Amazon S3 inventory [3]
- Amazon Macie for S3 analysis
- Restrict access to files in Amazon S3 buckets
- Terraform resources:
aws_s3_bucket_policy
- AWS managed policy: AmazonS3ReadOnlyAccess
- Amazon GuardDuty S3 protection
- Amazon Athena
Limitations
Activities
- Read https://stackoverflow.com/questions/tagged/amazon-s3?sort=votes
- Read https://www.sumologic.com/insight/10-things-might-not-know-using-s3/
See also
- AWS S3:
aws s3control
.aws s3
[cp | ls
|sync | presing
|mb | rm | rb
] - AWS S3,
aws s3, aws s3api, aws s3control, s3:
, Amazon S3 Storage Lens, AWS S3 replication, CRR, SSR, CAR, S3 Replication Time Control (S3 RTC), Website endpoint, Amazon Macie, Versioning, Lifecycle, Encryption, logging, Amazon S3 Inventory, Amazon S3 Batch Operations, Storage Classes, Amazon S3 clients, Terraform S3, AWS canned ACLs, Directory buckets, security,PutObject
- AWS storage, S3, EBS, EFS, AWS DataSync, AWS Storage costs
- Object storage: AWS S3, ceph, Scality, SWIFT, Cloudian, MinIO, Swift (OpenStack), Object versioning
Advertising: