Difference between revisions of "Amazon Simple Storage Service (S3)"

From wikieduonline
Jump to navigation Jump to search
Tags: Mobile web edit, Mobile edit
(99 intermediate revisions by 6 users not shown)
Line 1: Line 1:
−
Amazon S3 or Amazon Simple Storage Service a service offered by Amazon Web Services (AWS) that provides [[Object Storage]] through a web service interface or CLI.
+
[[wikipedia:Amazon S3]] ([[AWS timeline|March 2006]]) or Amazon Simple Storage Service a service offered by Amazon Web Services (AWS) since 2006 that provides [[Object Storage]] through a web service interface or CLI.
 +
 
 +
* [[AWS free tier]]: 5 GB
 +
 
 +
== Features ==
 +
* [[Encryption]]
 +
* [[AWS S3 replication|Replication]]
 +
* [[AWS S3 lifecycle|Lifecycle]]
 +
* [[AWS S3 versioning|Versioning]]
 +
* [[Object tagging]]
 +
 
 +
== [[Amazon S3 Storage Classes]] ==
 +
* Amazon S3 Standard is the default class.
 +
* [[Amazon S3 Intelligent-Tiering]] ([[AWS timeline|Sep 2021]])<ref>https://aws.amazon.com/blogs/aws/amazon-s3-intelligent-tiering-further-automating-cost-savings-for-short-lived-and-small-objects/</ref>
 +
* [[Amazon S3 Standard Infrequent Access (IA)]] is designed for less frequently accessed data. Typical use cases are backup and disaster recovery solutions.
 +
* Amazon S3 One Zone-Infrequent Access is designed for data that is not often needed but when required, needs to be accessed rapidly. Data is stored in one zone and if that zone is destroyed, all data is lost.
 +
* [[Amazon Glacier]] is designed for long-term storage of data that is infrequently accessed and where retrieval latency of minutes or hours is acceptable. "[[Glacier Deep Archive]]" is an alternative with a retrieval time of at least 12 hours, but 1/4th the price. It is intended as an alternative to magnetic tape libraries, and is designed for long term retention of data for 7 to 10 years.
 +
 
 +
== Pricing/Cost ==
 +
* {{AWS S3 pricing}}
  
 
== Commands ==
 
== Commands ==
 
See also: [[AWS Command Line Tool (CLI)]]
 
See also: [[AWS Command Line Tool (CLI)]]
−
* <code>aws s3 cp</code><ref>https://docs.aws.amazon.com/cli/latest/reference/s3/cp.html</ref>
+
* <code>[[aws s3 cp]]</code><ref>https://docs.aws.amazon.com/cli/latest/reference/s3/cp.html</ref>
−
* <code>aws s3 sync</code>
+
* <code>[[aws s3 sync]]</code>
−
* <code>aws s3 rm</code>
+
* <code>[[aws s3 rm]]</code>
 +
* <code>[[aws s3 help]]</code>
 +
* <code>[[aws s3 mb]]</code> <ref>https://docs.aws.amazon.com/cli/latest/reference/s3/mb.html</ref> (creates a [[bucket]])
 +
* <code>[[aws s3 rb]]</code>
 +
* <code>[[aws s3 presign]]</code>
  
 +
https://docs.aws.amazon.com/cli/latest/reference/s3/
  
 +
== Amazon S3 logs ==
 +
Amazon S3 allows users to enable or disable logging. If enabled, the logs are stored in Amazon S3 [[buckets]] which can then be analyzed. These logs contain useful information such as:
 +
* Date and time of access to requested content
 +
* Protocol used (HTTP, FTP, etc.)
 +
* HTTP status codes
 +
* Turnaround time
 +
* HTTP request message
  
  
 
== Encryption ==
 
== Encryption ==
−
Encryption is supported in AWS S3 (default [[Advanced Encryption Standard]] (AES) 256bit)
+
[[AWS S3 encryption|Encryption]] (2017) is supported in AWS S3 (default [[Advanced Encryption Standard]] (AES) 256bit)
−
*In transit (SSL/TLS)
+
*In [[transit]] ([[SSL]]/[[TLS]])
−
*At Rest:
+
*At [[rest]]:
−
**Server Side Encryption (SSE):
+
** [[Server Side Encryption]] (SSE):
 
**S3 Managed Keys (SSE-S3; 256bit);
 
**S3 Managed Keys (SSE-S3; 256bit);
−
**AWS Key Management Service, Managed Keys (SSE-KMS)
+
**[[AWS Key Management Service]], Managed Keys (SSE-KMS)
 
**Server Side Encryption with Customer Provided Keys (SSE-C)
 
**Server Side Encryption with Customer Provided Keys (SSE-C)
 
* Client Side Encryption (user encypts data on their local machine and then upload to AWS S3)
 
* Client Side Encryption (user encypts data on their local machine and then upload to AWS S3)
  
 +
== Replication ==
 +
* [[S3 Replication Time Control (S3 RTC)]]
 +
 +
 +
== News ==
 +
* Mar 2019 [[AWS S3 Glacier Deep Archive]]
 +
 +
== Terraform ==
 +
* [[Terraform S3 resources]]: <code>[[Terraform resources: aws_s3_bucket_policy|aws_s3_bucket_policy]]</code>
 +
* [[Terraform resource]]: <code>[[Terraform resource: aws_s3_bucket_website_configuration|aws_s3_bucket_website_configuration]]</code>
  
 
== Related terms ==
 
== Related terms ==
−
* [[AWS EBS]]
+
* [[Amazon EBS]], [[Amazon EFS]]
 +
* [[Amazon S3 clients]]: [[CloudBerry Explorer]], [[Transmit 5]], [[Cyberduck]]
 +
* [[s3fs-fuse]]
 +
* [[AWS Storage Gateway]]
 +
* [[Amazon Glacier]]
 +
* [[Amazon S3 Cross-Region Replication (CRR)]]
 +
* [[PrestoDB]] SQL engine
 +
* [[AWS]]: 1.4 Choose appropriate [[resilient storage]]
 +
* [[CloudFormation]]: <code>[[AWS::S3]], [[AWS::S3::Bucket]]</code>
 +
* [[Amazon S3 Storage Lens]]
 +
* [[Amazon S3 inventory]] <ref>https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-inventory.html</ref>
 +
* [[Amazon Macie]] for S3 [[analysis]]
 +
* [[Restrict access to files in Amazon S3 buckets]]
 +
* [[AWS managed policy: AmazonS3ReadOnlyAccess]]
 +
* [[Amazon GuardDuty S3 protection]]
 +
* [[Amazon Athena]]
 +
* [[BucketName:]]
 +
* [[BucketEncryption:]]
 +
* <code>[[s3streamcat]]</code>
 +
* [[File hosting service]]
 +
* [[Google Cloud Storage (GCS)]]
 +
* [[s3-website]]
 +
* [[Object lock]], [[WORM]]
 +
* [[Bucket keys]]
 +
 
 +
== Limitations ==
 +
* No bandwidth restriction
 +
* No [[size]] restriction by [[bucket]]
 +
 
 +
== Activities ==
 +
* Read https://stackoverflow.com/questions/tagged/amazon-s3?sort=votes
 +
* Read https://www.sumologic.com/insight/10-things-might-not-know-using-s3/
 +
* Read How do I use [[CloudFront]] to serve a static website hosted on Amazon S3? https://aws.amazon.com/premiumsupport/knowledge-center/cloudfront-serve-static-website/
  
 
== See also ==
 
== See also ==
−
* {{AWS}}
+
* {{aws s3}}
−
* [[Minio]] open source [[Object Storage]] implementation
+
* {{S3}}
−
* [[IBM Cloud]]
+
* {{AWS storage}}
 +
* {{Object Storage}}
 +
* {{Cloud storage}}
 +
 
  
−
[[Category:Computing]]
+
[[Category:AWS]]
−
[[Category:Internet]]
+
[[Category:Object storage]]

Revision as of 13:48, 22 December 2023

wikipedia:Amazon S3 (March 2006) or Amazon Simple Storage Service a service offered by Amazon Web Services (AWS) since 2006 that provides Object Storage through a web service interface or CLI.

Features

Amazon S3 Storage Classes

  • Amazon S3 Standard is the default class.
  • Amazon S3 Intelligent-Tiering (Sep 2021)[1]
  • Amazon S3 Standard Infrequent Access (IA) is designed for less frequently accessed data. Typical use cases are backup and disaster recovery solutions.
  • Amazon S3 One Zone-Infrequent Access is designed for data that is not often needed but when required, needs to be accessed rapidly. Data is stored in one zone and if that zone is destroyed, all data is lost.
  • Amazon Glacier is designed for long-term storage of data that is infrequently accessed and where retrieval latency of minutes or hours is acceptable. "Glacier Deep Archive" is an alternative with a retrieval time of at least 12 hours, but 1/4th the price. It is intended as an alternative to magnetic tape libraries, and is designed for long term retention of data for 7 to 10 years.

Pricing/Cost

Commands

See also: AWS Command Line Tool (CLI)

https://docs.aws.amazon.com/cli/latest/reference/s3/

Amazon S3 logs

Amazon S3 allows users to enable or disable logging. If enabled, the logs are stored in Amazon S3 buckets which can then be analyzed. These logs contain useful information such as:

  • Date and time of access to requested content
  • Protocol used (HTTP, FTP, etc.)
  • HTTP status codes
  • Turnaround time
  • HTTP request message


Encryption

Encryption (2017) is supported in AWS S3 (default Advanced Encryption Standard (AES) 256bit)

Replication


News

Terraform

Related terms

Limitations

  • No bandwidth restriction
  • No size restriction by bucket

Activities

See also

  • ↑ https://aws.amazon.com/blogs/aws/amazon-s3-intelligent-tiering-further-automating-cost-savings-for-short-lived-and-small-objects/
  • ↑ https://docs.aws.amazon.com/cli/latest/reference/s3/cp.html
  • ↑ https://docs.aws.amazon.com/cli/latest/reference/s3/mb.html
  • ↑ https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-inventory.html
    • Retrieved from "https://www.wikieduonline.com/index.php?title=Amazon_Simple_Storage_Service_(S3)&oldid=283711"

    Advertising: